This test is designed to test the resample step in the calwebb_image3 pipeline. At the end of the calwebb_image3 pipeline, the set of files defined in an association table will be distortion corrected and combined. Resample is the step that applies the distortion correction using the drizzling algorithm (as defined in the DrizzlePac handbook) and combines the listed files. For more information on the pipeline step visit the links below.
Step description: https://jwst-pipeline.readthedocs.io/en/latest/jwst/resample/main.html
Pipeline code: https://github.com/spacetelescope/jwst/tree/master/jwst/resample
The data for this test were created with the MIRI Data Simulator, and the documentation for that code can be found here: http://miri.ster.kuleuven.be/bin/view/Public/MIRISim_Public
A short description and link to the page: https://outerspace.stsci.edu/display/JWSTCC/Vanilla+Image+Combination
Definition of terms or acronymns.
JWST: James Webb Space Telescope
MIRI: Mid-Infrared Instrument
MIRISim: MIRI Data Simulator
This test is performed by creating a set of simulated data with multiple point sources located at specified coordinates. The simulator puts in the expected distortion, so the initial output data comes out of the simulator in distorted coordinates. When this data is then run through calwebb_detector1, calwebb_image2 and calwebbb_image3, the combined, undistorted image should have the point sources registered at the expected locations. In flight, this test can be repeated with known stars that should be found at their expected coordinates. This notebook also checks that flux values for simulated data with roughly equivalent input values show no systematic patterns after resampling. This portion of the test will only work with simulated data created for that purpose.
The set of data used in this particular test were created with the MIRI Data Simulator (MIRISim). Referring to the MIRISim link, you can see how to set up and run the simulator to re-create the input files if you wish. The data was run with a scene.ini file that specified what the scene should look like, with coordinates for the stars given in units of arcsecond offsets from the center of the field of view. The scene.ini file as well as the setup files simuation.ini and simulator.ini are needed to run the simulation.
Once in the mirisim conda environment, the simulation is run with the command line:
mirisim simulation.ini
The simulator created four files, two exposures each at two different dither positions, using the specified filter. Make sure the WCSAXES header keyword in the SCI extension is set to 2 and not 4. If it is set to 4, change it to 2.
The four files were then run individually through the calwebb_detector1 and calwebb_image2 pipelines. When running the calwebb_detector1 pipeline, increase the threshold for a detection in the jump step from 4 sigma to 10 sigma to avoid a current issue where the jump detection step flags a large percentage of pixels as jumps. This can be done on the command line. (commands to be typed start with $)
The pipelines can be run on the command line with the following commands or put into a script while using the pipeline conda environment.
$ strun calwebb_detector1.cfg filename --steps.jump.rejection_threshold 10.0
The output of the calwebb_detector1 pipeline is a set of four *rate.fits files which will then be run through the calwebb_image2 pipeline.
$ strun calwebb_image2.cfg filename
The output of the calwebb_image2 pipeline was then a set of four *cal.fits files. An association table was created that included these four files as input, and then the files and the association table were run through the calwebb_image3 pipeline.
The cal files are stored in artifactory, and this notebook is meant to pull those files for the test of resample. Step through the cells of this notebook to run calwebb_image3 and then check the alignment.
# Create a temporary directory to hold notebook output, and change the working directory to that directory.
from tempfile import TemporaryDirectory
import os
data_dir = TemporaryDirectory()
os.chdir(data_dir.name)
print(data_dir)
<TemporaryDirectory '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o'>
import os
if 'CRDS_CACHE_TYPE' in os.environ:
if os.environ['CRDS_CACHE_TYPE'] == 'local':
os.environ['CRDS_PATH'] = os.path.join(os.environ['HOME'], 'crds', 'cache')
elif os.path.isdir(os.environ['CRDS_CACHE_TYPE']):
os.environ['CRDS_PATH'] = os.environ['CRDS_CACHE_TYPE']
print('CRDS cache location: {}'.format(os.environ['CRDS_PATH']))
CRDS cache location: /grp/crds/cache
The following packages will need to be imported for the scripts to work.
from astropy.io import ascii, fits
from astropy.stats import sigma_clipped_stats
from astropy.table import Column
from astropy.visualization import SqrtStretch
from astropy.visualization.mpl_normalize import ImageNormalize
from ci_watson.artifactory_helpers import get_bigdata
import glob
from itertools import product
from jwst.datamodels import DrizProductModel, ImageModel
from jwst.pipeline import Detector1Pipeline, Image2Pipeline, Image3Pipeline
from jwst import associations
from jwst.associations.lib.rules_level3_base import DMS_Level3_Base
from jwst.associations import asn_from_list
import math
import matplotlib.pyplot as plt
import numpy as np
import os
from photutils import CircularAperture, DAOStarFinder, CircularAnnulus, aperture_photometry
from jwst.regtest.regtestdata import RegtestData
print("Downloading input files")
#This readnoise file is needed for use with simulated data which has higher readnoise than actual data.
readnoise = get_bigdata('jwst_validation_notebooks',
'validation_data',
'jump',
'jump_miri_test',
'jwst_mirisim_readnoise.fits')
filelist = ['starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits',
'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits',
'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits',
'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits',
'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits',
'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits',
'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits',
'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits']
for file in filelist:
input_file = get_bigdata('jwst_validation_notebooks',
'validation_data',
'outlier_detection',
'outlier_detection_miri_test',
file)
print("Finished Downloads")
Downloading input files Finished Downloads
# Run the calwebb_detector1 pipeline
# set up pipeline parameters
rej_thresh=10.0 # rejection threshold for jump step
print('There are ', len(filelist), ' images.')
slopelist = []
# loop over list of files
for file in filelist:
# set up pipeline parameters for input
pipe1 = Detector1Pipeline()
pipe1.jump.rejection_threshold = rej_thresh
pipe1.jump.override_readnoise = readnoise
pipe1.ramp_fit.override_readnoise = readnoise
pipe1.refpix.skip = True # needs update to simulator for this to work properly with simulated data
# set up output file name
base, remainder = file.split('.')
outname = base
pipe1.jump.output_file = outname+'.fits'
#pipe1.ramp_fit.output_file = outname+'.fits'
pipe1.output_file = outname+'.fits'
# Run pipeline on each file
rampfile = pipe1.run(file)
slopelist.append(rampfile)
# Close the input files
#file.close()
print('Detector 1 steps completed on all files.')
print(slopelist)
2022-10-06 05:25:25,956 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created. 2022-10-06 05:25:25,958 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created. 2022-10-06 05:25:25,960 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created. 2022-10-06 05:25:25,961 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created. 2022-10-06 05:25:25,962 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created. 2022-10-06 05:25:25,963 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created. 2022-10-06 05:25:25,964 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created. 2022-10-06 05:25:25,965 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created. 2022-10-06 05:25:25,967 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created. 2022-10-06 05:25:25,968 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created. 2022-10-06 05:25:25,969 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created. 2022-10-06 05:25:25,970 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created. 2022-10-06 05:25:25,971 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created. 2022-10-06 05:25:25,972 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created. 2022-10-06 05:25:25,976 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created. 2022-10-06 05:25:25,977 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created. 2022-10-06 05:25:25,978 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
There are 8 images.
2022-10-06 05:25:26,161 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits',).
2022-10-06 05:25:26,172 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-10-06 05:25:27,543 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-10-06 05:25:27,865 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-10-06 05:25:27,867 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-10-06 05:25:27,869 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-10-06 05:25:27,869 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-10-06 05:25:27,871 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-10-06 05:25:27,872 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-10-06 05:25:27,872 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits'.
2022-10-06 05:25:27,873 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-10-06 05:25:27,874 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-10-06 05:25:27,876 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-10-06 05:25:27,877 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-10-06 05:25:27,877 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-10-06 05:25:27,878 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-10-06 05:25:27,878 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-10-06 05:25:28,375 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:28,377 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:25:28,711 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-10-06 05:25:28,712 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-10-06 05:25:28,715 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-10-06 05:25:28,843 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:28,845 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:25:28,867 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-10-06 05:25:29,381 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-10-06 05:25:29,526 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:29,527 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-10-06 05:25:29,551 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-10-06 05:25:33,347 - stpipe.Detector1Pipeline.saturation - INFO - Detected 1071 saturated pixels
2022-10-06 05:25:33,414 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-10-06 05:25:33,424 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-10-06 05:25:33,556 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:33,558 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:25:33,578 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-10-06 05:25:33,579 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-10-06 05:25:33,579 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-10-06 05:25:33,915 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-10-06 05:25:34,016 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:34,017 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:25:34,357 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-10-06 05:25:34,463 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:34,464 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:25:34,806 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-10-06 05:25:34,910 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:34,912 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:25:34,935 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-10-06 05:25:35,974 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-10-06 05:25:36,075 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:36,077 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:25:36,101 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-10-06 05:25:37,492 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-10-06 05:25:37,597 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:37,598 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-10-06 05:25:37,622 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-10-06 05:25:38,005 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-10-06 05:25:38,117 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:38,118 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-10-06 05:25:38,142 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-10-06 05:25:44,984 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-10-06 05:25:44,985 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-10-06 05:25:46,324 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-10-06 05:25:46,439 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:46,440 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-10-06 05:25:46,441 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-10-06 05:25:46,444 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-10-06 05:25:46,542 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:25:46,544 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}
2022-10-06 05:25:46,554 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-10-06 05:25:46,569 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:25:46,594 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:25:47,172 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-10-06 05:25:47,326 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-10-06 05:25:49,916 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2982 pixels with at least one CR from five or more groups.
2022-10-06 05:25:49,917 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:25:49,918 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:25:50,533 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-10-06 05:25:53,258 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2445 pixels with at least one CR from five or more groups.
2022-10-06 05:25:53,260 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:25:53,260 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:25:53,789 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-10-06 05:25:56,417 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2541 pixels with at least one CR from five or more groups.
2022-10-06 05:25:56,417 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:25:56,418 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:25:56,984 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.81075 sec
2022-10-06 05:25:56,989 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.434643
2022-10-06 05:25:57,510 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_jump.fits
2022-10-06 05:25:57,511 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-10-06 05:25:57,643 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:25:57,645 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-10-06 05:25:57,668 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:25:57,669 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:25:57,720 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-10-06 05:25:57,721 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-10-06 05:25:58,055 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-10-06 05:25:58,056 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-10-06 05:26:32,982 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-10-06 05:26:32,984 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-10-06 05:26:33,086 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-10-06 05:26:33,221 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:26:33,223 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:26:33,267 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:26:33,268 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:26:33,273 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:26:33,378 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:26:33,380 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:26:33,426 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:26:33,426 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:26:33,432 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:26:33,546 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rateints.fits
2022-10-06 05:26:33,547 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-10-06 05:26:33,548 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:26:33,616 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits
2022-10-06 05:26:33,617 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-10-06 05:26:33,625 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-10-06 05:26:33,626 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-10-06 05:26:33,627 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-10-06 05:26:33,629 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-10-06 05:26:33,630 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-10-06 05:26:33,631 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-10-06 05:26:33,632 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-10-06 05:26:33,633 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-10-06 05:26:33,634 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-10-06 05:26:33,635 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-10-06 05:26:33,636 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-10-06 05:26:33,638 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-10-06 05:26:33,639 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-10-06 05:26:33,640 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-10-06 05:26:33,641 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-10-06 05:26:33,643 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-10-06 05:26:33,644 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-10-06 05:26:33,751 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits',).
2022-10-06 05:26:33,763 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-10-06 05:26:34,130 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-10-06 05:26:34,138 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-10-06 05:26:34,140 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-10-06 05:26:34,141 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-10-06 05:26:34,142 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-10-06 05:26:34,143 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-10-06 05:26:34,144 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-10-06 05:26:34,145 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits'.
2022-10-06 05:26:34,145 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-10-06 05:26:34,147 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-10-06 05:26:34,148 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-10-06 05:26:34,150 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-10-06 05:26:34,150 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-10-06 05:26:34,151 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-10-06 05:26:34,151 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-10-06 05:26:34,616 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:34,618 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:26:34,959 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-10-06 05:26:34,960 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-10-06 05:26:34,963 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-10-06 05:26:35,074 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:35,076 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:26:35,099 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-10-06 05:26:35,594 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-10-06 05:26:35,706 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:35,708 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-10-06 05:26:35,730 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-10-06 05:26:39,377 - stpipe.Detector1Pipeline.saturation - INFO - Detected 1071 saturated pixels
2022-10-06 05:26:39,436 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-10-06 05:26:39,445 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-10-06 05:26:39,549 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:39,550 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:26:39,571 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-10-06 05:26:39,572 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-10-06 05:26:39,572 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-10-06 05:26:39,902 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-10-06 05:26:40,010 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:40,012 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:26:40,349 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-10-06 05:26:40,457 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:40,459 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:26:40,796 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-10-06 05:26:40,906 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:40,908 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:26:40,931 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-10-06 05:26:41,548 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-10-06 05:26:41,660 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:41,662 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:26:41,685 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-10-06 05:26:43,077 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-10-06 05:26:43,191 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:43,192 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-10-06 05:26:43,215 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-10-06 05:26:43,604 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-10-06 05:26:43,718 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:43,719 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-10-06 05:26:43,743 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-10-06 05:26:45,153 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-10-06 05:26:45,154 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-10-06 05:26:46,544 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-10-06 05:26:46,689 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:46,691 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-10-06 05:26:46,691 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-10-06 05:26:46,694 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-10-06 05:26:46,801 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:26:46,803 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}
2022-10-06 05:26:46,813 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-10-06 05:26:46,827 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:26:46,852 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:26:47,425 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-10-06 05:26:47,581 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-10-06 05:26:50,147 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2941 pixels with at least one CR from five or more groups.
2022-10-06 05:26:50,148 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:26:50,149 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:26:50,761 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-10-06 05:26:53,408 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2686 pixels with at least one CR from five or more groups.
2022-10-06 05:26:53,409 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:26:53,410 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:26:53,996 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-10-06 05:26:56,647 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2543 pixels with at least one CR from five or more groups.
2022-10-06 05:26:56,648 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:26:56,648 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:26:57,229 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.80255 sec
2022-10-06 05:26:57,233 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.419473
2022-10-06 05:26:57,746 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_jump.fits
2022-10-06 05:26:57,747 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-10-06 05:26:57,872 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:26:57,874 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-10-06 05:26:57,898 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:26:57,899 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:26:57,953 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-10-06 05:26:57,953 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-10-06 05:26:58,276 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-10-06 05:26:58,278 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-10-06 05:27:32,656 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-10-06 05:27:32,658 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-10-06 05:27:32,749 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-10-06 05:27:32,884 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:27:32,885 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:27:32,926 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:27:32,927 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:27:32,931 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:27:33,029 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:27:33,030 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:27:33,073 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:27:33,074 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:27:33,078 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:27:33,188 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rateints.fits
2022-10-06 05:27:33,189 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-10-06 05:27:33,189 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:27:33,255 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits
2022-10-06 05:27:33,256 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-10-06 05:27:33,264 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-10-06 05:27:33,266 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-10-06 05:27:33,267 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-10-06 05:27:33,268 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-10-06 05:27:33,269 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-10-06 05:27:33,270 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-10-06 05:27:33,272 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-10-06 05:27:33,273 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-10-06 05:27:33,274 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-10-06 05:27:33,275 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-10-06 05:27:33,276 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-10-06 05:27:33,277 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-10-06 05:27:33,279 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-10-06 05:27:33,280 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-10-06 05:27:33,282 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-10-06 05:27:33,283 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-10-06 05:27:33,284 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-10-06 05:27:33,384 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits',).
2022-10-06 05:27:33,394 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-10-06 05:27:33,800 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-10-06 05:27:33,811 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-10-06 05:27:33,812 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-10-06 05:27:33,813 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-10-06 05:27:33,814 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-10-06 05:27:33,815 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-10-06 05:27:33,816 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-10-06 05:27:33,817 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits'.
2022-10-06 05:27:33,817 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-10-06 05:27:33,819 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-10-06 05:27:33,820 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-10-06 05:27:33,822 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-10-06 05:27:33,822 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-10-06 05:27:33,823 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-10-06 05:27:33,823 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-10-06 05:27:34,327 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:34,328 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:27:34,659 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-10-06 05:27:34,660 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-10-06 05:27:34,663 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-10-06 05:27:34,764 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:34,766 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:27:34,787 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-10-06 05:27:35,259 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-10-06 05:27:35,361 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:35,362 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-10-06 05:27:35,383 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-10-06 05:27:38,806 - stpipe.Detector1Pipeline.saturation - INFO - Detected 1100 saturated pixels
2022-10-06 05:27:38,866 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-10-06 05:27:38,874 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-10-06 05:27:38,975 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:38,977 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:27:38,997 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-10-06 05:27:38,998 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-10-06 05:27:38,998 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-10-06 05:27:39,328 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-10-06 05:27:39,430 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:39,432 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:27:39,766 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-10-06 05:27:39,869 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:39,870 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:27:40,210 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-10-06 05:27:40,316 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:40,318 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:27:40,340 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-10-06 05:27:40,942 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-10-06 05:27:41,050 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:41,051 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:27:41,073 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-10-06 05:27:42,406 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-10-06 05:27:42,515 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:42,516 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-10-06 05:27:42,538 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-10-06 05:27:42,908 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-10-06 05:27:43,015 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:43,016 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-10-06 05:27:43,038 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-10-06 05:27:44,323 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-10-06 05:27:44,326 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-10-06 05:27:45,710 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-10-06 05:27:45,854 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:45,856 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-10-06 05:27:45,856 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-10-06 05:27:45,859 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-10-06 05:27:45,967 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:27:45,969 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}
2022-10-06 05:27:45,980 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-10-06 05:27:45,994 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:27:46,018 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:27:46,580 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-10-06 05:27:46,731 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-10-06 05:27:49,238 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2858 pixels with at least one CR from five or more groups.
2022-10-06 05:27:49,239 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:27:49,239 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:27:49,835 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-10-06 05:27:52,401 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2639 pixels with at least one CR from five or more groups.
2022-10-06 05:27:52,402 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:27:52,403 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:27:52,968 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-10-06 05:27:55,437 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2384 pixels with at least one CR from five or more groups.
2022-10-06 05:27:55,438 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:27:55,438 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:27:55,967 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.38617 sec
2022-10-06 05:27:55,971 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 9.990852
2022-10-06 05:27:56,462 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_jump.fits
2022-10-06 05:27:56,464 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-10-06 05:27:56,582 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:27:56,584 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-10-06 05:27:56,606 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:27:56,607 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:27:56,657 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-10-06 05:27:56,658 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-10-06 05:27:56,972 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-10-06 05:27:56,974 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-10-06 05:28:31,526 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-10-06 05:28:31,528 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-10-06 05:28:31,622 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-10-06 05:28:31,769 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:28:31,770 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:28:31,813 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:28:31,813 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:28:31,818 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:28:31,933 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:28:31,934 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:28:31,978 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:28:31,979 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:28:31,984 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:28:32,097 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rateints.fits
2022-10-06 05:28:32,098 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-10-06 05:28:32,099 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:28:32,165 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits
2022-10-06 05:28:32,166 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-10-06 05:28:32,174 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-10-06 05:28:32,176 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-10-06 05:28:32,177 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-10-06 05:28:32,178 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-10-06 05:28:32,179 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-10-06 05:28:32,180 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-10-06 05:28:32,181 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-10-06 05:28:32,182 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-10-06 05:28:32,184 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-10-06 05:28:32,185 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-10-06 05:28:32,186 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-10-06 05:28:32,187 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-10-06 05:28:32,188 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-10-06 05:28:32,190 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-10-06 05:28:32,191 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-10-06 05:28:32,192 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-10-06 05:28:32,193 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-10-06 05:28:32,307 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits',).
2022-10-06 05:28:32,318 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-10-06 05:28:32,684 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-10-06 05:28:32,690 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-10-06 05:28:32,692 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-10-06 05:28:32,693 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-10-06 05:28:32,694 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-10-06 05:28:32,695 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-10-06 05:28:32,696 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-10-06 05:28:32,697 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits'.
2022-10-06 05:28:32,697 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-10-06 05:28:32,699 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-10-06 05:28:32,700 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-10-06 05:28:32,702 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-10-06 05:28:32,702 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-10-06 05:28:32,703 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-10-06 05:28:32,703 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-10-06 05:28:33,181 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:33,183 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:28:33,527 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-10-06 05:28:33,528 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-10-06 05:28:33,531 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-10-06 05:28:33,648 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:33,650 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:28:33,673 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-10-06 05:28:34,191 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-10-06 05:28:34,311 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:34,313 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-10-06 05:28:34,341 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-10-06 05:28:37,962 - stpipe.Detector1Pipeline.saturation - INFO - Detected 1101 saturated pixels
2022-10-06 05:28:38,021 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-10-06 05:28:38,029 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-10-06 05:28:38,145 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:38,147 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:28:38,168 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-10-06 05:28:38,169 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-10-06 05:28:38,169 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-10-06 05:28:38,502 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-10-06 05:28:38,620 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:38,622 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:28:38,964 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-10-06 05:28:39,080 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:39,082 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:28:39,427 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-10-06 05:28:39,543 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:39,545 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:28:39,568 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-10-06 05:28:40,175 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-10-06 05:28:40,283 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:40,285 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:28:40,306 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-10-06 05:28:41,593 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-10-06 05:28:41,702 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:41,704 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-10-06 05:28:41,725 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-10-06 05:28:42,102 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-10-06 05:28:42,214 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:42,216 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-10-06 05:28:42,238 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-10-06 05:28:43,545 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-10-06 05:28:43,546 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-10-06 05:28:44,908 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-10-06 05:28:45,035 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:45,037 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-10-06 05:28:45,037 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-10-06 05:28:45,040 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-10-06 05:28:45,151 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:28:45,153 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}
2022-10-06 05:28:45,164 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-10-06 05:28:45,178 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:28:45,204 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:28:45,767 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-10-06 05:28:45,919 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-10-06 05:28:48,492 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2849 pixels with at least one CR from five or more groups.
2022-10-06 05:28:48,493 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:28:48,494 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:28:49,102 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-10-06 05:28:51,737 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2632 pixels with at least one CR from five or more groups.
2022-10-06 05:28:51,738 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:28:51,739 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:28:52,320 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-10-06 05:28:54,959 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2479 pixels with at least one CR from five or more groups.
2022-10-06 05:28:54,960 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:28:54,961 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:28:55,509 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.74063 sec
2022-10-06 05:28:55,512 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.348447
2022-10-06 05:28:56,026 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_jump.fits
2022-10-06 05:28:56,027 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-10-06 05:28:56,154 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:28:56,155 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-10-06 05:28:56,180 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:28:56,181 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:28:56,235 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-10-06 05:28:56,236 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-10-06 05:28:56,567 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-10-06 05:28:56,569 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-10-06 05:29:33,115 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-10-06 05:29:33,117 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-10-06 05:29:33,210 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-10-06 05:29:33,353 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:29:33,354 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:29:33,396 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:29:33,397 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:29:33,401 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:29:33,522 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:29:33,523 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:29:33,570 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:29:33,571 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:29:33,576 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:29:33,695 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rateints.fits
2022-10-06 05:29:33,696 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-10-06 05:29:33,697 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:29:33,766 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits
2022-10-06 05:29:33,766 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-10-06 05:29:33,774 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-10-06 05:29:33,776 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-10-06 05:29:33,777 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-10-06 05:29:33,778 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-10-06 05:29:33,780 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-10-06 05:29:33,781 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-10-06 05:29:33,782 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-10-06 05:29:33,784 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-10-06 05:29:33,785 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-10-06 05:29:33,786 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-10-06 05:29:33,787 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-10-06 05:29:33,788 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-10-06 05:29:33,789 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-10-06 05:29:33,791 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-10-06 05:29:33,792 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-10-06 05:29:33,793 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-10-06 05:29:33,794 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-10-06 05:29:33,915 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits',).
2022-10-06 05:29:33,925 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-10-06 05:29:34,299 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-10-06 05:29:34,306 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-10-06 05:29:34,308 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-10-06 05:29:34,309 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-10-06 05:29:34,309 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-10-06 05:29:34,311 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-10-06 05:29:34,312 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-10-06 05:29:34,313 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits'.
2022-10-06 05:29:34,314 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-10-06 05:29:34,315 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-10-06 05:29:34,317 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-10-06 05:29:34,318 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-10-06 05:29:34,319 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-10-06 05:29:34,319 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-10-06 05:29:34,320 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-10-06 05:29:34,814 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:34,816 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:29:35,164 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-10-06 05:29:35,165 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-10-06 05:29:35,168 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-10-06 05:29:35,297 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:35,298 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:29:35,326 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-10-06 05:29:35,824 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-10-06 05:29:35,941 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:35,942 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-10-06 05:29:35,964 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-10-06 05:29:39,597 - stpipe.Detector1Pipeline.saturation - INFO - Detected 957 saturated pixels
2022-10-06 05:29:39,658 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-10-06 05:29:39,667 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-10-06 05:29:39,790 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:39,791 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:29:39,813 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-10-06 05:29:39,814 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-10-06 05:29:39,814 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-10-06 05:29:40,152 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-10-06 05:29:40,281 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:40,283 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:29:40,631 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-10-06 05:29:40,760 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:40,762 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:29:41,116 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-10-06 05:29:41,240 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:41,241 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:29:41,265 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-10-06 05:29:41,892 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-10-06 05:29:42,016 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:42,018 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:29:42,041 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-10-06 05:29:43,422 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-10-06 05:29:43,549 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:43,551 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-10-06 05:29:43,575 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-10-06 05:29:43,959 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-10-06 05:29:44,085 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:44,087 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-10-06 05:29:44,110 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-10-06 05:29:45,426 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-10-06 05:29:45,427 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-10-06 05:29:46,787 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-10-06 05:29:46,920 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:46,922 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-10-06 05:29:46,922 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-10-06 05:29:46,925 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-10-06 05:29:47,042 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:29:47,044 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}
2022-10-06 05:29:47,055 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-10-06 05:29:47,070 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:29:47,095 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:29:47,670 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-10-06 05:29:47,822 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-10-06 05:29:50,395 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2601 pixels with at least one CR from five or more groups.
2022-10-06 05:29:50,396 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:29:50,397 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:29:50,968 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-10-06 05:29:53,658 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2274 pixels with at least one CR from five or more groups.
2022-10-06 05:29:53,659 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:29:53,660 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:29:54,254 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-10-06 05:29:56,793 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2368 pixels with at least one CR from five or more groups.
2022-10-06 05:29:56,794 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:29:56,794 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:29:57,385 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.71449 sec
2022-10-06 05:29:57,389 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.333710
2022-10-06 05:29:57,882 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_jump.fits
2022-10-06 05:29:57,883 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-10-06 05:29:58,005 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:29:58,007 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-10-06 05:29:58,030 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:29:58,030 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:29:58,082 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-10-06 05:29:58,082 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-10-06 05:29:58,400 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-10-06 05:29:58,402 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-10-06 05:30:32,454 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-10-06 05:30:32,456 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-10-06 05:30:32,547 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-10-06 05:30:32,693 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:30:32,694 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:30:32,736 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:30:32,737 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:30:32,741 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:30:32,857 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:30:32,859 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:30:32,903 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:30:32,904 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:30:32,908 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:30:33,020 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rateints.fits
2022-10-06 05:30:33,021 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-10-06 05:30:33,022 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:30:33,089 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits
2022-10-06 05:30:33,090 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-10-06 05:30:33,098 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-10-06 05:30:33,100 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-10-06 05:30:33,101 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-10-06 05:30:33,102 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-10-06 05:30:33,103 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-10-06 05:30:33,104 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-10-06 05:30:33,105 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-10-06 05:30:33,107 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-10-06 05:30:33,108 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-10-06 05:30:33,109 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-10-06 05:30:33,110 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-10-06 05:30:33,111 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-10-06 05:30:33,113 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-10-06 05:30:33,114 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-10-06 05:30:33,115 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-10-06 05:30:33,116 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-10-06 05:30:33,118 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-10-06 05:30:33,235 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits',).
2022-10-06 05:30:33,245 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-10-06 05:30:33,607 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-10-06 05:30:33,612 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-10-06 05:30:33,613 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-10-06 05:30:33,614 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-10-06 05:30:33,614 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-10-06 05:30:33,615 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-10-06 05:30:33,616 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-10-06 05:30:33,616 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits'.
2022-10-06 05:30:33,617 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-10-06 05:30:33,618 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-10-06 05:30:33,619 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-10-06 05:30:33,620 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-10-06 05:30:33,620 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-10-06 05:30:33,621 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-10-06 05:30:33,621 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-10-06 05:30:34,098 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:34,099 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:30:34,432 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-10-06 05:30:34,433 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-10-06 05:30:34,436 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-10-06 05:30:34,561 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:34,563 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:30:34,586 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-10-06 05:30:35,095 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-10-06 05:30:35,224 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:35,225 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-10-06 05:30:35,249 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-10-06 05:30:38,780 - stpipe.Detector1Pipeline.saturation - INFO - Detected 957 saturated pixels
2022-10-06 05:30:38,840 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-10-06 05:30:38,848 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-10-06 05:30:38,967 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:38,968 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:30:38,990 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-10-06 05:30:38,990 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-10-06 05:30:38,991 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-10-06 05:30:39,327 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-10-06 05:30:39,454 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:39,456 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:30:39,795 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-10-06 05:30:39,919 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:39,921 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:30:40,262 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-10-06 05:30:40,385 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:40,386 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:30:40,414 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-10-06 05:30:41,027 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-10-06 05:30:41,153 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:41,155 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:30:41,179 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-10-06 05:30:42,437 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-10-06 05:30:42,563 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:42,565 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-10-06 05:30:42,588 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-10-06 05:30:42,971 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-10-06 05:30:43,086 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:43,087 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-10-06 05:30:43,113 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-10-06 05:30:44,406 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-10-06 05:30:44,407 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-10-06 05:30:45,720 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-10-06 05:30:45,857 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:45,859 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-10-06 05:30:45,860 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-10-06 05:30:45,863 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-10-06 05:30:45,983 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:30:45,985 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}
2022-10-06 05:30:45,996 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-10-06 05:30:46,011 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:30:46,036 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:30:46,601 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-10-06 05:30:46,754 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-10-06 05:30:49,217 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2838 pixels with at least one CR from five or more groups.
2022-10-06 05:30:49,217 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:30:49,218 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:30:49,878 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-10-06 05:30:52,457 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2162 pixels with at least one CR from five or more groups.
2022-10-06 05:30:52,458 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:30:52,458 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:30:53,023 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-10-06 05:30:55,672 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2259 pixels with at least one CR from five or more groups.
2022-10-06 05:30:55,673 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:30:55,674 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:30:56,249 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.64724 sec
2022-10-06 05:30:56,253 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.256396
2022-10-06 05:30:56,755 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_jump.fits
2022-10-06 05:30:56,756 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-10-06 05:30:56,882 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:30:56,883 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-10-06 05:30:56,908 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:30:56,909 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:30:56,963 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-10-06 05:30:56,964 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-10-06 05:30:57,284 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-10-06 05:30:57,286 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-10-06 05:31:31,898 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-10-06 05:31:31,902 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-10-06 05:31:31,996 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-10-06 05:31:32,153 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:31:32,154 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:31:32,196 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:31:32,197 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:31:32,202 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:31:32,326 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:31:32,327 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:31:32,371 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:31:32,372 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:31:32,377 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:31:32,491 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rateints.fits
2022-10-06 05:31:32,492 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-10-06 05:31:32,493 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:31:32,558 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits
2022-10-06 05:31:32,559 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-10-06 05:31:32,567 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-10-06 05:31:32,568 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-10-06 05:31:32,569 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-10-06 05:31:32,570 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-10-06 05:31:32,571 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-10-06 05:31:32,572 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-10-06 05:31:32,573 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-10-06 05:31:32,574 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-10-06 05:31:32,575 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-10-06 05:31:32,576 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-10-06 05:31:32,578 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-10-06 05:31:32,578 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-10-06 05:31:32,579 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-10-06 05:31:32,581 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-10-06 05:31:32,582 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-10-06 05:31:32,583 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-10-06 05:31:32,584 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-10-06 05:31:32,709 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits',).
2022-10-06 05:31:32,719 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-10-06 05:31:33,087 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-10-06 05:31:33,091 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-10-06 05:31:33,092 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-10-06 05:31:33,093 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-10-06 05:31:33,094 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-10-06 05:31:33,094 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-10-06 05:31:33,095 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-10-06 05:31:33,096 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits'.
2022-10-06 05:31:33,096 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-10-06 05:31:33,097 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-10-06 05:31:33,098 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-10-06 05:31:33,099 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-10-06 05:31:33,099 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-10-06 05:31:33,100 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-10-06 05:31:33,100 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-10-06 05:31:33,587 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:33,588 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:31:33,929 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-10-06 05:31:33,930 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-10-06 05:31:33,933 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-10-06 05:31:34,059 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:34,061 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:31:34,083 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-10-06 05:31:34,581 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-10-06 05:31:34,710 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:34,711 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-10-06 05:31:34,735 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-10-06 05:31:38,528 - stpipe.Detector1Pipeline.saturation - INFO - Detected 971 saturated pixels
2022-10-06 05:31:38,591 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-10-06 05:31:38,600 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-10-06 05:31:38,731 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:38,732 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:31:38,755 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-10-06 05:31:38,756 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-10-06 05:31:38,757 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-10-06 05:31:39,103 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-10-06 05:31:39,228 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:39,229 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:31:39,575 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-10-06 05:31:39,703 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:39,705 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:31:40,050 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-10-06 05:31:40,178 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:40,180 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:31:40,203 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-10-06 05:31:40,841 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-10-06 05:31:40,977 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:40,978 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:31:41,006 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-10-06 05:31:42,496 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-10-06 05:31:42,623 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:42,625 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-10-06 05:31:42,649 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-10-06 05:31:43,034 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-10-06 05:31:43,187 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:43,188 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-10-06 05:31:43,213 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-10-06 05:31:44,532 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-10-06 05:31:44,533 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-10-06 05:31:45,916 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-10-06 05:31:46,052 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:46,054 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-10-06 05:31:46,055 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-10-06 05:31:46,058 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-10-06 05:31:46,181 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits>,).
2022-10-06 05:31:46,182 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}
2022-10-06 05:31:46,194 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-10-06 05:31:46,208 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:31:46,233 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:31:46,816 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-10-06 05:31:46,971 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-10-06 05:31:49,569 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2614 pixels with at least one CR from five or more groups.
2022-10-06 05:31:49,570 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:31:49,571 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:31:50,178 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-10-06 05:31:52,788 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2258 pixels with at least one CR from five or more groups.
2022-10-06 05:31:52,789 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:31:52,790 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:31:53,311 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-10-06 05:31:55,909 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2515 pixels with at least one CR from five or more groups.
2022-10-06 05:31:55,910 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:31:55,911 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:31:56,470 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.65266 sec
2022-10-06 05:31:56,474 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 10.280366
2022-10-06 05:31:56,979 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_jump.fits
2022-10-06 05:31:56,979 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-10-06 05:31:57,116 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:31:57,118 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-10-06 05:31:57,141 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:31:57,142 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:31:57,193 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-10-06 05:31:57,194 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-10-06 05:31:57,519 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-10-06 05:31:57,520 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-10-06 05:32:33,759 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-10-06 05:32:33,761 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-10-06 05:32:33,857 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-10-06 05:32:34,012 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:32:34,014 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:32:34,057 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:32:34,058 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:32:34,062 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:32:34,186 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_jump.fits>,).
2022-10-06 05:32:34,187 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:32:34,231 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:32:34,231 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:32:34,236 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:32:34,350 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rateints.fits
2022-10-06 05:32:34,351 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-10-06 05:32:34,352 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:32:34,420 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits
2022-10-06 05:32:34,421 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-10-06 05:32:34,429 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-10-06 05:32:34,430 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-10-06 05:32:34,432 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-10-06 05:32:34,433 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-10-06 05:32:34,434 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-10-06 05:32:34,435 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-10-06 05:32:34,436 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-10-06 05:32:34,437 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-10-06 05:32:34,437 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-10-06 05:32:34,439 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-10-06 05:32:34,440 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-10-06 05:32:34,441 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-10-06 05:32:34,442 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-10-06 05:32:34,443 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-10-06 05:32:34,444 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-10-06 05:32:34,445 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-10-06 05:32:34,446 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-10-06 05:32:34,572 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits',).
2022-10-06 05:32:34,582 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-10-06 05:32:34,954 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits' reftypes = ['dark', 'gain', 'ipc', 'linearity', 'mask', 'persat', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-10-06 05:32:34,958 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits'.
2022-10-06 05:32:34,960 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits'.
2022-10-06 05:32:34,960 - stpipe.Detector1Pipeline - INFO - Prefetch for IPC reference file is 'N/A'.
2022-10-06 05:32:34,961 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits'.
2022-10-06 05:32:34,962 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits'.
2022-10-06 05:32:34,964 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-10-06 05:32:34,964 - stpipe.Detector1Pipeline - INFO - Override for READNOISE reference file is '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits'.
2022-10-06 05:32:34,965 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is '/grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits'.
2022-10-06 05:32:34,966 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is '/grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits'.
2022-10-06 05:32:34,967 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits'.
2022-10-06 05:32:34,968 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is 'N/A'.
2022-10-06 05:32:34,969 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-10-06 05:32:34,969 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-10-06 05:32:34,970 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-10-06 05:32:35,455 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:35,457 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:32:35,789 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES=1 is a power of 2; correction not needed
2022-10-06 05:32:35,790 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-10-06 05:32:35,793 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-10-06 05:32:35,918 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:35,919 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:32:35,942 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_miri_mask_0028.fits
2022-10-06 05:32:36,438 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-10-06 05:32:36,566 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:36,567 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'n_pix_grow_sat': 1}
2022-10-06 05:32:36,591 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_miri_saturation_0026.fits
2022-10-06 05:32:40,151 - stpipe.Detector1Pipeline.saturation - INFO - Detected 975 saturated pixels
2022-10-06 05:32:40,211 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-10-06 05:32:40,221 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-10-06 05:32:40,360 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:40,362 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:32:40,383 - stpipe.Detector1Pipeline.ipc - INFO - Using IPC reference file N/A
2022-10-06 05:32:40,384 - stpipe.Detector1Pipeline.ipc - WARNING - No IPC reference file found
2022-10-06 05:32:40,385 - stpipe.Detector1Pipeline.ipc - WARNING - IPC step will be skipped
2022-10-06 05:32:40,720 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-10-06 05:32:40,836 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:40,838 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:32:41,176 - stpipe.Detector1Pipeline.firstframe - INFO - Step firstframe done
2022-10-06 05:32:41,290 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:41,292 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:32:41,632 - stpipe.Detector1Pipeline.lastframe - INFO - Step lastframe done
2022-10-06 05:32:41,749 - stpipe.Detector1Pipeline.reset - INFO - Step reset running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:41,751 - stpipe.Detector1Pipeline.reset - INFO - Step reset parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:32:41,777 - stpipe.Detector1Pipeline.reset - INFO - Using RESET reference file /grp/crds/cache/references/jwst/jwst_miri_reset_0047.fits
2022-10-06 05:32:42,384 - stpipe.Detector1Pipeline.reset - INFO - Step reset done
2022-10-06 05:32:42,500 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:42,502 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:32:42,524 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_miri_linearity_0024.fits
2022-10-06 05:32:43,749 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-10-06 05:32:43,881 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:43,882 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}
2022-10-06 05:32:43,906 - stpipe.Detector1Pipeline.rscd - INFO - Using RSCD reference file /grp/crds/cache/references/jwst/jwst_miri_rscd_0014.fits
2022-10-06 05:32:44,287 - stpipe.Detector1Pipeline.rscd - INFO - Step rscd done
2022-10-06 05:32:44,413 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:44,415 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}
2022-10-06 05:32:44,438 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_miri_dark_0058.fits
2022-10-06 05:32:45,716 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=3, ngroups=25, nframes=1, groupgap=0
2022-10-06 05:32:45,717 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=2, ngroups=200, nframes=1, groupgap=0
2022-10-06 05:32:46,989 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-10-06 05:32:47,121 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:47,122 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-10-06 05:32:47,122 - stpipe.Detector1Pipeline.refpix - INFO - Step skipped.
2022-10-06 05:32:47,125 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-10-06 05:32:47,243 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits>,).
2022-10-06 05:32:47,245 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 10.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0, 'after_jump_flag_dn1': 0.0, 'after_jump_flag_time1': 0.0, 'after_jump_flag_dn2': 0.0, 'after_jump_flag_time2': 0.0}
2022-10-06 05:32:47,256 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 10 sigma
2022-10-06 05:32:47,270 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:32:47,294 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:32:47,861 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-10-06 05:32:48,011 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
2022-10-06 05:32:50,513 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2560 pixels with at least one CR from five or more groups.
2022-10-06 05:32:50,514 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:32:50,514 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:32:51,053 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 2:
2022-10-06 05:32:53,612 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2391 pixels with at least one CR from five or more groups.
2022-10-06 05:32:53,613 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:32:53,613 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:32:54,130 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 3:
2022-10-06 05:32:56,694 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2417 pixels with at least one CR from five or more groups.
2022-10-06 05:32:56,694 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-10-06 05:32:56,695 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-10-06 05:32:57,225 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.36358 sec
2022-10-06 05:32:57,229 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 9.972539
2022-10-06 05:32:57,731 - stpipe.Detector1Pipeline.jump - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_jump.fits
2022-10-06 05:32:57,732 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-10-06 05:32:57,860 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(3, 25, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:32:57,861 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'suppress_one_group': True, 'maximum_cores': 'none'}
2022-10-06 05:32:57,884 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/jwst_mirisim_readnoise.fits
2022-10-06 05:32:57,885 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_miri_gain_0008.fits
2022-10-06 05:32:57,937 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-10-06 05:32:57,938 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
2022-10-06 05:32:58,257 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of leading groups that are flagged as DO_NOT_USE: 1
2022-10-06 05:32:58,258 - stpipe.Detector1Pipeline.ramp_fit - INFO - MIRI dataset has all pixels in the final group flagged as DO_NOT_USE.
2022-10-06 05:33:32,196 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 23
2022-10-06 05:33:32,198 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 3
2022-10-06 05:33:32,290 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-10-06 05:33:32,436 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:33:32,437 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:33:32,476 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:33:32,477 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:33:32,481 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:33:32,599 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(3, 1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_jump.fits>,).
2022-10-06 05:33:32,600 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': ''}
2022-10-06 05:33:32,642 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-10-06 05:33:32,642 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-10-06 05:33:32,647 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-10-06 05:33:32,754 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rateints.fits
2022-10-06 05:33:32,755 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-10-06 05:33:32,756 - stpipe.Detector1Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:33:32,819 - stpipe.Detector1Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits
2022-10-06 05:33:32,820 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
Detector 1 steps completed on all files. [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>, <ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>]
# Run Calwebb_image2 on output files from detector1
print('There are ', len(slopelist), ' images.')
callist = []
# cycle through files
for rampfile in slopelist:
# create an object for the pipeline
pipe2 = Image2Pipeline()
filename = rampfile.meta.filename
# Set pipeline parameters
pipe2.save_results = True
pipe2.output_file = filename +'_cal.fits'
pipe2.resample.save_results = True
pipe2.suffix = None
calfile = pipe2.run(rampfile)
callist.append(calfile)
print(callist)
2022-10-06 05:33:32,834 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-10-06 05:33:32,835 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-10-06 05:33:32,837 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-10-06 05:33:32,838 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-10-06 05:33:32,839 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-10-06 05:33:32,840 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-10-06 05:33:32,958 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:32,962 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-10-06 05:33:32,969 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-10-06 05:33:32,980 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-10-06 05:33:32,982 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-10-06 05:33:32,982 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-10-06 05:33:32,983 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-10-06 05:33:32,983 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-10-06 05:33:32,983 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-10-06 05:33:32,985 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-10-06 05:33:32,986 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-10-06 05:33:32,986 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-10-06 05:33:32,987 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-10-06 05:33:32,989 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-10-06 05:33:32,989 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-10-06 05:33:32,990 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-10-06 05:33:32,990 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-10-06 05:33:32,990 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-10-06 05:33:32,991 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-10-06 05:33:32,991 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-10-06 05:33:32,991 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-10-06 05:33:32,993 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-10-06 05:33:32,993 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-10-06 05:33:32,993 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-10-06 05:33:32,994 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-10-06 05:33:32,994 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-10-06 05:33:32,994 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
There are 8 images.
2022-10-06 05:33:33,030 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-10-06 05:33:33,030 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits> ...
2022-10-06 05:33:33,157 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:33,158 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-10-06 05:33:33,353 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-10-06 05:33:33,429 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.019532876 -0.016147752 0.021999558 0.015037465 359.990697171 0.017630270 359.987889494 -0.013568846
2022-10-06 05:33:33,430 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.019532876 -0.016147752 0.021999558 0.015037465 359.990697171 0.017630270 359.987889494 -0.013568846
2022-10-06 05:33:33,430 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-10-06 05:33:33,464 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:33:33,476 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:33:33,476 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:33:33,490 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-10-06 05:33:33,623 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:33,625 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-10-06 05:33:34,098 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:34,099 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:34,099 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:34,106 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:34,242 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-10-06 05:33:34,377 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:34,379 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-10-06 05:33:34,420 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-10-06 05:33:34,421 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-10-06 05:33:34,512 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-10-06 05:33:34,513 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-10-06 05:33:34,513 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-10-06 05:33:34,514 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-10-06 05:33:34,600 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-10-06 05:33:34,603 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-10-06 05:33:34,603 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-10-06 05:33:34,604 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-10-06 05:33:34,618 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-10-06 05:33:34,744 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:34,746 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-10-06 05:33:34,772 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-10-06 05:33:34,791 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-10-06 05:33:34,792 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:33:34,792 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-10-06 05:33:34,792 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-10-06 05:33:34,906 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-10-06 05:33:35,562 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:35,739 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-10-06 05:33:36,355 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:36,545 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-10-06 05:33:37,138 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:37,328 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-10-06 05:33:37,906 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:38,095 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:308: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-10-06 05:33:38,128 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.019529633 -0.016360379 0.022280129 0.014982155 359.990661583 0.017756872 359.987911088 -0.013585662
2022-10-06 05:33:38,255 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_i2d.fits
2022-10-06 05:33:38,256 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-10-06 05:33:38,256 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-10-06 05:33:38,258 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-10-06 05:33:38,258 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:33:38,416 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits
2022-10-06 05:33:38,416 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-10-06 05:33:38,421 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-10-06 05:33:38,422 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-10-06 05:33:38,423 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-10-06 05:33:38,424 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-10-06 05:33:38,426 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-10-06 05:33:38,427 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-10-06 05:33:38,560 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:38,564 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-10-06 05:33:38,571 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-10-06 05:33:38,577 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-10-06 05:33:38,578 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-10-06 05:33:38,578 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-10-06 05:33:38,578 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-10-06 05:33:38,579 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-10-06 05:33:38,579 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-10-06 05:33:38,580 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-10-06 05:33:38,581 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-10-06 05:33:38,581 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-10-06 05:33:38,582 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-10-06 05:33:38,583 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-10-06 05:33:38,583 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-10-06 05:33:38,584 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-10-06 05:33:38,584 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-10-06 05:33:38,584 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-10-06 05:33:38,585 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-10-06 05:33:38,585 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-10-06 05:33:38,586 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-10-06 05:33:38,586 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-10-06 05:33:38,587 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-10-06 05:33:38,587 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-10-06 05:33:38,588 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-10-06 05:33:38,588 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-10-06 05:33:38,588 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-10-06 05:33:38,623 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-10-06 05:33:38,624 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits> ...
2022-10-06 05:33:38,753 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:38,755 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-10-06 05:33:38,938 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-10-06 05:33:39,013 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.019532876 -0.016147752 0.021999558 0.015037465 359.990697171 0.017630270 359.987889494 -0.013568846
2022-10-06 05:33:39,014 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.019532876 -0.016147752 0.021999558 0.015037465 359.990697171 0.017630270 359.987889494 -0.013568846
2022-10-06 05:33:39,015 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-10-06 05:33:39,048 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:33:39,059 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:33:39,060 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:33:39,074 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-10-06 05:33:39,201 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:39,203 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-10-06 05:33:39,312 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:39,313 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:39,313 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:39,320 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:39,458 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-10-06 05:33:39,617 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:39,619 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-10-06 05:33:39,644 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-10-06 05:33:39,645 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-10-06 05:33:39,732 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-10-06 05:33:39,733 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-10-06 05:33:39,734 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-10-06 05:33:39,734 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-10-06 05:33:39,779 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-10-06 05:33:39,782 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-10-06 05:33:39,783 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-10-06 05:33:39,784 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-10-06 05:33:39,799 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-10-06 05:33:39,930 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:39,932 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-10-06 05:33:39,959 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-10-06 05:33:39,978 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-10-06 05:33:39,979 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:33:39,979 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-10-06 05:33:39,980 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-10-06 05:33:40,096 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-10-06 05:33:40,719 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:40,897 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-10-06 05:33:41,514 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:41,711 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-10-06 05:33:42,303 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:42,495 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-10-06 05:33:43,086 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:43,281 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:308: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-10-06 05:33:43,313 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.019529633 -0.016360379 0.022280129 0.014982155 359.990661583 0.017756872 359.987911088 -0.013585662
2022-10-06 05:33:43,443 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_i2d.fits
2022-10-06 05:33:43,444 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-10-06 05:33:43,445 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-10-06 05:33:43,446 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-10-06 05:33:43,447 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:33:43,613 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits
2022-10-06 05:33:43,614 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-10-06 05:33:43,618 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-10-06 05:33:43,619 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-10-06 05:33:43,621 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-10-06 05:33:43,622 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-10-06 05:33:43,623 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-10-06 05:33:43,624 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-10-06 05:33:43,765 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:43,770 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-10-06 05:33:43,778 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-10-06 05:33:43,786 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-10-06 05:33:43,787 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-10-06 05:33:43,787 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-10-06 05:33:43,787 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-10-06 05:33:43,788 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-10-06 05:33:43,788 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-10-06 05:33:43,789 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-10-06 05:33:43,789 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-10-06 05:33:43,790 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-10-06 05:33:43,791 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-10-06 05:33:43,792 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-10-06 05:33:43,792 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-10-06 05:33:43,793 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-10-06 05:33:43,793 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-10-06 05:33:43,793 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-10-06 05:33:43,794 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-10-06 05:33:43,794 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-10-06 05:33:43,794 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-10-06 05:33:43,795 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-10-06 05:33:43,796 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-10-06 05:33:43,796 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-10-06 05:33:43,796 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-10-06 05:33:43,796 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-10-06 05:33:43,797 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-10-06 05:33:43,829 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-10-06 05:33:43,830 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits> ...
2022-10-06 05:33:43,966 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:43,967 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-10-06 05:33:44,150 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-10-06 05:33:44,222 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020172025 -0.017469545 0.022638707 0.013715672 359.991336319 0.016308478 359.988528642 -0.014890638
2022-10-06 05:33:44,223 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020172025 -0.017469545 0.022638707 0.013715672 359.991336319 0.016308478 359.988528642 -0.014890638
2022-10-06 05:33:44,223 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-10-06 05:33:44,256 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:33:44,266 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:33:44,267 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:33:44,280 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-10-06 05:33:44,411 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:44,412 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-10-06 05:33:44,515 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:44,516 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:44,516 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:44,523 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:44,651 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-10-06 05:33:44,781 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:44,783 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-10-06 05:33:44,806 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-10-06 05:33:44,806 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-10-06 05:33:44,890 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-10-06 05:33:44,891 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-10-06 05:33:44,891 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-10-06 05:33:44,892 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-10-06 05:33:44,937 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-10-06 05:33:44,939 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-10-06 05:33:44,940 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-10-06 05:33:44,941 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-10-06 05:33:44,956 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-10-06 05:33:45,088 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:45,089 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-10-06 05:33:45,116 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-10-06 05:33:45,134 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-10-06 05:33:45,134 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:33:45,134 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-10-06 05:33:45,135 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-10-06 05:33:45,246 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-10-06 05:33:45,832 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:46,013 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-10-06 05:33:46,574 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:46,768 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-10-06 05:33:47,334 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:47,532 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-10-06 05:33:48,091 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:48,287 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:308: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-10-06 05:33:48,321 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.020168782 -0.017682172 0.022919277 0.013660362 359.991300731 0.016435079 359.988550236 -0.014907455
2022-10-06 05:33:48,448 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_i2d.fits
2022-10-06 05:33:48,449 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-10-06 05:33:48,449 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-10-06 05:33:48,451 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-10-06 05:33:48,451 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:33:48,608 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits
2022-10-06 05:33:48,609 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-10-06 05:33:48,614 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-10-06 05:33:48,615 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-10-06 05:33:48,616 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-10-06 05:33:48,617 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-10-06 05:33:48,618 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-10-06 05:33:48,620 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-10-06 05:33:48,779 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:48,784 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-10-06 05:33:48,791 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-10-06 05:33:48,794 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-10-06 05:33:48,796 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-10-06 05:33:48,797 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-10-06 05:33:48,797 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-10-06 05:33:48,797 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-10-06 05:33:48,798 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-10-06 05:33:48,799 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-10-06 05:33:48,800 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-10-06 05:33:48,800 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-10-06 05:33:48,801 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-10-06 05:33:48,802 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-10-06 05:33:48,803 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-10-06 05:33:48,803 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-10-06 05:33:48,803 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-10-06 05:33:48,804 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-10-06 05:33:48,804 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-10-06 05:33:48,804 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-10-06 05:33:48,805 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-10-06 05:33:48,806 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-10-06 05:33:48,807 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-10-06 05:33:48,807 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-10-06 05:33:48,807 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-10-06 05:33:48,808 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-10-06 05:33:48,808 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-10-06 05:33:48,841 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-10-06 05:33:48,841 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits> ...
2022-10-06 05:33:48,975 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:48,977 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-10-06 05:33:49,158 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-10-06 05:33:49,230 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020172025 -0.017469545 0.022638707 0.013715672 359.991336319 0.016308478 359.988528642 -0.014890638
2022-10-06 05:33:49,231 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020172025 -0.017469545 0.022638707 0.013715672 359.991336319 0.016308478 359.988528642 -0.014890638
2022-10-06 05:33:49,231 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-10-06 05:33:49,263 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:33:49,273 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:33:49,274 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:33:49,287 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-10-06 05:33:49,422 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:49,424 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-10-06 05:33:49,535 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:49,536 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:49,537 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:49,544 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:49,677 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-10-06 05:33:49,811 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:49,813 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-10-06 05:33:49,836 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-10-06 05:33:49,837 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-10-06 05:33:49,919 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-10-06 05:33:49,920 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-10-06 05:33:49,921 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-10-06 05:33:49,921 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-10-06 05:33:49,966 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-10-06 05:33:49,968 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-10-06 05:33:49,969 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-10-06 05:33:49,970 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-10-06 05:33:49,985 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-10-06 05:33:50,115 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:50,117 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-10-06 05:33:50,143 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-10-06 05:33:50,162 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-10-06 05:33:50,163 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:33:50,163 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-10-06 05:33:50,164 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-10-06 05:33:50,275 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-10-06 05:33:50,874 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:51,056 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-10-06 05:33:51,656 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:51,849 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-10-06 05:33:52,458 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:52,658 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-10-06 05:33:53,240 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:53,433 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:308: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-10-06 05:33:53,467 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.020168782 -0.017682172 0.022919277 0.013660362 359.991300731 0.016435079 359.988550236 -0.014907455
2022-10-06 05:33:53,596 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_i2d.fits
2022-10-06 05:33:53,597 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-10-06 05:33:53,598 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-10-06 05:33:53,600 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-10-06 05:33:53,601 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:33:53,762 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits
2022-10-06 05:33:53,763 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-10-06 05:33:53,769 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-10-06 05:33:53,770 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-10-06 05:33:53,772 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-10-06 05:33:53,773 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-10-06 05:33:53,775 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-10-06 05:33:53,776 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-10-06 05:33:53,946 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:53,952 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-10-06 05:33:53,961 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-10-06 05:33:53,964 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-10-06 05:33:53,966 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-10-06 05:33:53,967 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-10-06 05:33:53,967 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-10-06 05:33:53,968 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-10-06 05:33:53,969 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-10-06 05:33:53,970 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-10-06 05:33:53,970 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-10-06 05:33:53,971 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-10-06 05:33:53,972 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-10-06 05:33:53,973 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-10-06 05:33:53,974 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-10-06 05:33:53,974 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-10-06 05:33:53,975 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-10-06 05:33:53,975 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-10-06 05:33:53,975 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-10-06 05:33:53,976 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-10-06 05:33:53,976 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-10-06 05:33:53,977 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-10-06 05:33:53,978 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-10-06 05:33:53,978 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-10-06 05:33:53,978 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-10-06 05:33:53,979 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-10-06 05:33:53,979 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-10-06 05:33:54,014 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-10-06 05:33:54,015 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits> ...
2022-10-06 05:33:54,155 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:54,157 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-10-06 05:33:54,339 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-10-06 05:33:54,413 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020403170 -0.019920319 0.022869851 0.011264898 359.991567464 0.013857704 359.988759787 -0.017341412
2022-10-06 05:33:54,414 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020403170 -0.019920319 0.022869851 0.011264898 359.991567464 0.013857704 359.988759787 -0.017341412
2022-10-06 05:33:54,414 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-10-06 05:33:54,446 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:33:54,457 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:33:54,459 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:33:54,472 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-10-06 05:33:54,612 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:54,613 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-10-06 05:33:54,723 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:54,725 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:54,725 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:54,732 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:54,864 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-10-06 05:33:55,007 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:55,008 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-10-06 05:33:55,033 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-10-06 05:33:55,034 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-10-06 05:33:55,118 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-10-06 05:33:55,119 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-10-06 05:33:55,120 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-10-06 05:33:55,120 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-10-06 05:33:55,166 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-10-06 05:33:55,169 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-10-06 05:33:55,169 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-10-06 05:33:55,170 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-10-06 05:33:55,186 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-10-06 05:33:55,326 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:33:55,328 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-10-06 05:33:55,355 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-10-06 05:33:55,374 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-10-06 05:33:55,375 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:33:55,376 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-10-06 05:33:55,376 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-10-06 05:33:55,491 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-10-06 05:33:56,090 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:56,272 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-10-06 05:33:56,862 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:57,059 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-10-06 05:33:57,630 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:57,824 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-10-06 05:33:58,384 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:33:58,571 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:308: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-10-06 05:33:58,605 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.020399927 -0.020132946 0.023150422 0.011209589 359.991531876 0.013984305 359.988781381 -0.017358229
2022-10-06 05:33:58,732 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_i2d.fits
2022-10-06 05:33:58,733 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-10-06 05:33:58,734 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-10-06 05:33:58,736 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-10-06 05:33:58,736 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:33:58,895 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits
2022-10-06 05:33:58,896 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-10-06 05:33:58,901 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-10-06 05:33:58,902 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-10-06 05:33:58,904 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-10-06 05:33:58,905 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-10-06 05:33:58,906 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-10-06 05:33:58,908 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-10-06 05:33:59,069 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:59,074 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-10-06 05:33:59,082 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-10-06 05:33:59,085 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-10-06 05:33:59,087 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-10-06 05:33:59,087 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-10-06 05:33:59,088 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-10-06 05:33:59,088 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-10-06 05:33:59,089 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-10-06 05:33:59,090 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-10-06 05:33:59,091 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-10-06 05:33:59,091 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-10-06 05:33:59,092 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-10-06 05:33:59,094 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-10-06 05:33:59,094 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-10-06 05:33:59,094 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-10-06 05:33:59,095 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-10-06 05:33:59,095 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-10-06 05:33:59,096 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-10-06 05:33:59,096 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-10-06 05:33:59,097 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-10-06 05:33:59,098 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-10-06 05:33:59,098 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-10-06 05:33:59,099 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-10-06 05:33:59,099 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-10-06 05:33:59,099 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-10-06 05:33:59,100 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-10-06 05:33:59,134 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-10-06 05:33:59,135 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits> ...
2022-10-06 05:33:59,274 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:59,276 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-10-06 05:33:59,458 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-10-06 05:33:59,531 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.020403170 -0.019920319 0.022869851 0.011264898 359.991567464 0.013857704 359.988759787 -0.017341412
2022-10-06 05:33:59,533 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.020403170 -0.019920319 0.022869851 0.011264898 359.991567464 0.013857704 359.988759787 -0.017341412
2022-10-06 05:33:59,533 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-10-06 05:33:59,565 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:33:59,576 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:33:59,577 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:33:59,590 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-10-06 05:33:59,726 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:33:59,728 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-10-06 05:33:59,830 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:59,832 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:59,833 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:59,839 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:33:59,966 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-10-06 05:34:00,113 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:34:00,115 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-10-06 05:34:00,138 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-10-06 05:34:00,139 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-10-06 05:34:00,222 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-10-06 05:34:00,224 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-10-06 05:34:00,224 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-10-06 05:34:00,225 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-10-06 05:34:00,269 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-10-06 05:34:00,272 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-10-06 05:34:00,273 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-10-06 05:34:00,273 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-10-06 05:34:00,288 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-10-06 05:34:00,430 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:34:00,432 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-10-06 05:34:00,458 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-10-06 05:34:00,477 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-10-06 05:34:00,478 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:34:00,478 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-10-06 05:34:00,479 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-10-06 05:34:00,590 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-10-06 05:34:01,170 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:01,346 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-10-06 05:34:01,911 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:02,102 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-10-06 05:34:02,665 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:02,855 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-10-06 05:34:03,419 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:03,606 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:308: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-10-06 05:34:03,638 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.020399927 -0.020132946 0.023150422 0.011209589 359.991531876 0.013984305 359.988781381 -0.017358229
2022-10-06 05:34:03,762 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_i2d.fits
2022-10-06 05:34:03,764 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-10-06 05:34:03,764 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-10-06 05:34:03,766 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-10-06 05:34:03,766 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:34:03,927 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits
2022-10-06 05:34:03,928 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-10-06 05:34:03,933 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-10-06 05:34:03,934 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-10-06 05:34:03,935 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-10-06 05:34:03,937 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-10-06 05:34:03,938 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-10-06 05:34:03,939 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-10-06 05:34:04,093 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:34:04,098 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-10-06 05:34:04,107 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-10-06 05:34:04,111 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-10-06 05:34:04,113 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-10-06 05:34:04,114 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-10-06 05:34:04,114 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-10-06 05:34:04,115 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-10-06 05:34:04,115 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-10-06 05:34:04,117 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-10-06 05:34:04,118 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-10-06 05:34:04,119 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-10-06 05:34:04,120 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-10-06 05:34:04,121 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-10-06 05:34:04,122 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-10-06 05:34:04,122 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-10-06 05:34:04,123 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-10-06 05:34:04,123 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-10-06 05:34:04,124 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-10-06 05:34:04,124 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-10-06 05:34:04,125 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-10-06 05:34:04,126 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-10-06 05:34:04,127 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-10-06 05:34:04,127 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-10-06 05:34:04,128 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-10-06 05:34:04,128 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-10-06 05:34:04,129 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-10-06 05:34:04,163 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-10-06 05:34:04,164 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits> ...
2022-10-06 05:34:04,318 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:34:04,320 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-10-06 05:34:04,526 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-10-06 05:34:04,601 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.021939052 -0.019421471 0.024405733 0.011763747 359.993103346 0.014356552 359.990295669 -0.016842564
2022-10-06 05:34:04,602 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.021939052 -0.019421471 0.024405733 0.011763747 359.993103346 0.014356552 359.990295669 -0.016842564
2022-10-06 05:34:04,603 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-10-06 05:34:04,635 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:34:04,645 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:34:04,646 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:34:04,660 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-10-06 05:34:04,807 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:34:04,809 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-10-06 05:34:04,921 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:34:04,922 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:34:04,922 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:34:04,929 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:34:05,062 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-10-06 05:34:05,205 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:34:05,207 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-10-06 05:34:05,230 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-10-06 05:34:05,231 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-10-06 05:34:05,314 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-10-06 05:34:05,315 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-10-06 05:34:05,316 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-10-06 05:34:05,317 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-10-06 05:34:05,362 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-10-06 05:34:05,364 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-10-06 05:34:05,365 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-10-06 05:34:05,365 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-10-06 05:34:05,380 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-10-06 05:34:05,527 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits>,).
2022-10-06 05:34:05,529 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-10-06 05:34:05,554 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-10-06 05:34:05,573 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-10-06 05:34:05,573 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:34:05,573 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-10-06 05:34:05,574 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-10-06 05:34:05,686 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-10-06 05:34:06,275 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:06,453 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-10-06 05:34:07,035 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:07,237 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-10-06 05:34:07,799 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:07,986 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-10-06 05:34:08,538 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:08,724 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:308: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-10-06 05:34:08,755 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021935809 -0.019634097 0.024686304 0.011708437 359.993067758 0.014483153 359.990317263 -0.016859381
2022-10-06 05:34:08,879 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_i2d.fits
2022-10-06 05:34:08,880 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-10-06 05:34:08,880 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_rate.fits_cal
2022-10-06 05:34:08,882 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-10-06 05:34:08,882 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:34:09,039 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits
2022-10-06 05:34:09,040 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
2022-10-06 05:34:09,044 - stpipe.Image2Pipeline - INFO - Image2Pipeline instance created.
2022-10-06 05:34:09,045 - stpipe.Image2Pipeline.bkg_subtract - INFO - BackgroundStep instance created.
2022-10-06 05:34:09,046 - stpipe.Image2Pipeline.assign_wcs - INFO - AssignWcsStep instance created.
2022-10-06 05:34:09,047 - stpipe.Image2Pipeline.flat_field - INFO - FlatFieldStep instance created.
2022-10-06 05:34:09,049 - stpipe.Image2Pipeline.photom - INFO - PhotomStep instance created.
2022-10-06 05:34:09,050 - stpipe.Image2Pipeline.resample - INFO - ResampleStep instance created.
2022-10-06 05:34:09,197 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:34:09,202 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmp_oms749o/starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits_cal.fits', 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_bsub': False, 'steps': {'bkg_subtract': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_combined_background': False, 'sigma': 3.0, 'maxiters': None, 'wfss_mmag_extract': None}, 'assign_wcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}, 'flat_field': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}, 'photom': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}}}
2022-10-06 05:34:09,209 - stpipe.Image2Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits' reftypes = ['area', 'camera', 'collimator', 'dflat', 'disperser', 'distortion', 'drizpars', 'fflat', 'filteroffset', 'flat', 'fore', 'fpa', 'ifufore', 'ifupost', 'ifuslicer', 'msa', 'ote', 'photom', 'regions', 'sflat', 'specwcs', 'wavelengthrange', 'wfssbkg']
2022-10-06 05:34:09,212 - stpipe.Image2Pipeline - INFO - Prefetch for AREA reference file is '/grp/crds/cache/references/jwst/jwst_miri_area_0004.fits'.
2022-10-06 05:34:09,213 - stpipe.Image2Pipeline - INFO - Prefetch for CAMERA reference file is 'N/A'.
2022-10-06 05:34:09,214 - stpipe.Image2Pipeline - INFO - Prefetch for COLLIMATOR reference file is 'N/A'.
2022-10-06 05:34:09,214 - stpipe.Image2Pipeline - INFO - Prefetch for DFLAT reference file is 'N/A'.
2022-10-06 05:34:09,214 - stpipe.Image2Pipeline - INFO - Prefetch for DISPERSER reference file is 'N/A'.
2022-10-06 05:34:09,215 - stpipe.Image2Pipeline - INFO - Prefetch for DISTORTION reference file is '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf'.
2022-10-06 05:34:09,216 - stpipe.Image2Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-10-06 05:34:09,216 - stpipe.Image2Pipeline - INFO - Prefetch for FFLAT reference file is 'N/A'.
2022-10-06 05:34:09,217 - stpipe.Image2Pipeline - INFO - Prefetch for FILTEROFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf'.
2022-10-06 05:34:09,218 - stpipe.Image2Pipeline - INFO - Prefetch for FLAT reference file is '/grp/crds/cache/references/jwst/jwst_miri_flat_0626.fits'.
2022-10-06 05:34:09,219 - stpipe.Image2Pipeline - INFO - Prefetch for FORE reference file is 'N/A'.
2022-10-06 05:34:09,219 - stpipe.Image2Pipeline - INFO - Prefetch for FPA reference file is 'N/A'.
2022-10-06 05:34:09,219 - stpipe.Image2Pipeline - INFO - Prefetch for IFUFORE reference file is 'N/A'.
2022-10-06 05:34:09,220 - stpipe.Image2Pipeline - INFO - Prefetch for IFUPOST reference file is 'N/A'.
2022-10-06 05:34:09,220 - stpipe.Image2Pipeline - INFO - Prefetch for IFUSLICER reference file is 'N/A'.
2022-10-06 05:34:09,221 - stpipe.Image2Pipeline - INFO - Prefetch for MSA reference file is 'N/A'.
2022-10-06 05:34:09,221 - stpipe.Image2Pipeline - INFO - Prefetch for OTE reference file is 'N/A'.
2022-10-06 05:34:09,221 - stpipe.Image2Pipeline - INFO - Prefetch for PHOTOM reference file is '/grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits'.
2022-10-06 05:34:09,222 - stpipe.Image2Pipeline - INFO - Prefetch for REGIONS reference file is 'N/A'.
2022-10-06 05:34:09,222 - stpipe.Image2Pipeline - INFO - Prefetch for SFLAT reference file is 'N/A'.
2022-10-06 05:34:09,223 - stpipe.Image2Pipeline - INFO - Prefetch for SPECWCS reference file is 'N/A'.
2022-10-06 05:34:09,223 - stpipe.Image2Pipeline - INFO - Prefetch for WAVELENGTHRANGE reference file is 'N/A'.
2022-10-06 05:34:09,223 - stpipe.Image2Pipeline - INFO - Prefetch for WFSSBKG reference file is 'N/A'.
2022-10-06 05:34:09,224 - stpipe.Image2Pipeline - INFO - Starting calwebb_image2 ...
2022-10-06 05:34:09,256 - stpipe.Image2Pipeline - INFO - Processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-10-06 05:34:09,257 - stpipe.Image2Pipeline - INFO - Working on input <ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits> ...
2022-10-06 05:34:09,405 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:34:09,407 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-10-06 05:34:09,589 - stpipe.Image2Pipeline.assign_wcs - INFO - Created a MIRI mir_image pipeline with references {'distortion': '/grp/crds/cache/references/jwst/jwst_miri_distortion_0028.asdf', 'filteroffset': '/grp/crds/cache/references/jwst/jwst_miri_filteroffset_0005.asdf', 'specwcs': None, 'regions': None, 'wavelengthrange': None, 'camera': None, 'collimator': None, 'disperser': None, 'fore': None, 'fpa': None, 'msa': None, 'ote': None, 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-10-06 05:34:09,661 - stpipe.Image2Pipeline.assign_wcs - INFO - Update S_REGION to POLYGON ICRS 0.021939052 -0.019421471 0.024405733 0.011763747 359.993103346 0.014356552 359.990295669 -0.016842564
2022-10-06 05:34:09,662 - stpipe.Image2Pipeline.assign_wcs - INFO - assign_wcs updated S_REGION to POLYGON ICRS 0.021939052 -0.019421471 0.024405733 0.011763747 359.993103346 0.014356552 359.990295669 -0.016842564
2022-10-06 05:34:09,662 - stpipe.Image2Pipeline.assign_wcs - INFO - COMPLETED assign_wcs
2022-10-06 05:34:09,694 - stpipe.Image2Pipeline.assign_wcs - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:34:09,705 - stpipe.Image2Pipeline.assign_wcs - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:34:09,705 - stpipe.Image2Pipeline.assign_wcs - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:34:09,719 - stpipe.Image2Pipeline.assign_wcs - INFO - Step assign_wcs done
2022-10-06 05:34:09,862 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:34:09,864 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-10-06 05:34:09,973 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_PARTIAL_DATA does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:34:09,974 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_LOW_QUAL does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:34:09,974 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword CDP_UNRELIABLE_ERROR does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:34:09,981 - stpipe.Image2Pipeline.flat_field - WARNING - Keyword DIFF_PATTERN does not correspond to an existing DQ mnemonic, so will be ignored
2022-10-06 05:34:10,114 - stpipe.Image2Pipeline.flat_field - INFO - Step flat_field done
2022-10-06 05:34:10,269 - stpipe.Image2Pipeline.photom - INFO - Step photom running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:34:10,270 - stpipe.Image2Pipeline.photom - INFO - Step photom parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-10-06 05:34:10,295 - stpipe.Image2Pipeline.photom - INFO - Using photom reference file: /grp/crds/cache/references/jwst/jwst_miri_photom_0073.fits
2022-10-06 05:34:10,296 - stpipe.Image2Pipeline.photom - INFO - Using area reference file: /grp/crds/cache/references/jwst/jwst_miri_area_0004.fits
2022-10-06 05:34:10,382 - stpipe.Image2Pipeline.photom - INFO - Using instrument: MIRI
2022-10-06 05:34:10,383 - stpipe.Image2Pipeline.photom - INFO - detector: MIRIMAGE
2022-10-06 05:34:10,383 - stpipe.Image2Pipeline.photom - INFO - exp_type: MIR_IMAGE
2022-10-06 05:34:10,384 - stpipe.Image2Pipeline.photom - INFO - filter: F1130W
2022-10-06 05:34:10,431 - stpipe.Image2Pipeline.photom - INFO - Pixel area map copied to output.
2022-10-06 05:34:10,433 - stpipe.Image2Pipeline.photom - INFO - subarray: FULL
2022-10-06 05:34:10,434 - stpipe.Image2Pipeline.photom - WARNING - Expected to find one matching row in table, found 0.
2022-10-06 05:34:10,434 - stpipe.Image2Pipeline.photom - INFO - PHOTMJSR value: 2.54947
2022-10-06 05:34:10,449 - stpipe.Image2Pipeline.photom - INFO - Step photom done
2022-10-06 05:34:10,601 - stpipe.Image2Pipeline.resample - INFO - Step resample running with args (<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits>,).
2022-10-06 05:34:10,603 - stpipe.Image2Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-10-06 05:34:10,630 - stpipe.Image2Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-10-06 05:34:10,650 - stpipe.Image2Pipeline.resample - INFO - Driz parameter kernel: square
2022-10-06 05:34:10,651 - stpipe.Image2Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:34:10,651 - stpipe.Image2Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-10-06 05:34:10,651 - stpipe.Image2Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-10-06 05:34:10,764 - stpipe.Image2Pipeline.resample - INFO - Resampling science data
2022-10-06 05:34:11,360 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:11,537 - stpipe.Image2Pipeline.resample - INFO - Resampling var_rnoise
2022-10-06 05:34:12,118 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:12,306 - stpipe.Image2Pipeline.resample - INFO - Resampling var_poisson
2022-10-06 05:34:12,878 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:13,065 - stpipe.Image2Pipeline.resample - INFO - Resampling var_flat
2022-10-06 05:34:13,622 - stpipe.Image2Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1022, 1031)
2022-10-06 05:34:13,809 - stpipe.Image2Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:308: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-10-06 05:34:13,841 - stpipe.Image2Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021935809 -0.019634097 0.024686304 0.011708437 359.993067758 0.014483153 359.990317263 -0.016859381
2022-10-06 05:34:13,972 - stpipe.Image2Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_i2d.fits
2022-10-06 05:34:13,973 - stpipe.Image2Pipeline.resample - INFO - Step resample done
2022-10-06 05:34:13,974 - stpipe.Image2Pipeline - INFO - Finished processing product starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_rate.fits_cal
2022-10-06 05:34:13,975 - stpipe.Image2Pipeline - INFO - ... ending calwebb_image2
2022-10-06 05:34:13,975 - stpipe.Image2Pipeline - INFO - Results used CRDS context: jwst_0988.pmap
2022-10-06 05:34:14,132 - stpipe.Image2Pipeline - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits
2022-10-06 05:34:14,133 - stpipe.Image2Pipeline - INFO - Step Image2Pipeline done
[[<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits>], [<ImageModel(1024, 1032) from starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits>]]
# use asn_from_list to create association table
calfiles = glob.glob('starfield*_cal.fits')
asn = asn_from_list.asn_from_list(calfiles, rule=DMS_Level3_Base, product_name='starfield_50star4ptdither_combined.fits')
# use this if you need to add non'science' exposure types
#asn['products'][0]['members'][1]['exptype'] = 'background'
#asn['products'][0]['members'][2]['exptype'] = 'sourcecat'
# dump association table to a .json file for use in image3
with open('starfield_50star4ptdither_asnfile.json', 'w') as fp:
fp.write(asn.dump()[1])
print(asn)
jwnoprogram-a3001_none_010_asn with 1 products Rule=DMS_Level3_Base No constraints Products: starfield_50star4ptdither_combined.fits with 8 members
Use the association table to process the .cal files that were output from calwebb_image2. That will be the input for calwebb_image3 that uses the resample step to combine each of the individual images.
# Use regtest infrastructure to access all input files associated with the association file
#rtdata = RegtestData(inputs_root="jwst_validation_notebooks", env="validation_data")
#rtdata.get_asn("resample/resample_miri_test/starfield_50star4ptdither_771_asnfile.json")
#rtdata.input #this should be the list of files associated with the asn
# Run Calwebb_image3 on the association table
# set any specific parameters
# tweakreg parameters to allow data to run
fwhm = 3.318 #3.27 # Gaussian kernel FWHM of objects expected, default=2.5
minobj = 5 # minimum number of objects needed to match positions for a good fit, default=15
snr = 50 # signal to noise threshold, default=5
sigma = 3 # clipping limit, in sigma units, used when performing fit, default=3
fit_geom ='shift' # ftype of affine transformation to be considered when fitting catalogs, default='general'
use2dhist = False # boolean indicating whether to use 2D histogram to find initial offset, default=True
pipe3=Image3Pipeline()
pipe3.tweakreg.kernel_fwhm = fwhm
pipe3.tweakreg.snr_threshold = snr
pipe3.tweakreg.minobj = minobj
pipe3.tweakreg.sigma = sigma
pipe3.tweakreg.fitgeometry = fit_geom
pipe3.tweakreg.use2dhist = use2dhist
#pipe3.tweakreg.skip = True # test to see if this affects the final output
pipe3.source_catalog.save_results = True
pipe3.save_results = True
# run Image3
#im = pipe3.run(rtdata.input)
image = pipe3.run('starfield_50star4ptdither_asnfile.json')
print('Image 3 pipeline finished.')
2022-10-06 05:34:14,159 - stpipe.Image3Pipeline - INFO - Image3Pipeline instance created.
2022-10-06 05:34:14,160 - stpipe.Image3Pipeline.assign_mtwcs - INFO - AssignMTWcsStep instance created.
2022-10-06 05:34:14,162 - stpipe.Image3Pipeline.tweakreg - INFO - TweakRegStep instance created.
2022-10-06 05:34:14,163 - stpipe.Image3Pipeline.skymatch - INFO - SkyMatchStep instance created.
2022-10-06 05:34:14,165 - stpipe.Image3Pipeline.outlier_detection - INFO - OutlierDetectionStep instance created.
2022-10-06 05:34:14,166 - stpipe.Image3Pipeline.resample - INFO - ResampleStep instance created.
2022-10-06 05:34:14,167 - stpipe.Image3Pipeline.source_catalog - INFO - SourceCatalogStep instance created.
2022-10-06 05:34:14,334 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline running with args ('starfield_50star4ptdither_asnfile.json',).
2022-10-06 05:34:14,341 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'steps': {'assign_mtwcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'assign_mtwcs', 'search_output_file': True, 'input_dir': ''}, 'tweakreg': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': False, 'catalog_format': 'ecsv', 'kernel_fwhm': 3.318, 'snr_threshold': 50, 'sharplo': 0.2, 'sharphi': 1.0, 'roundlo': -1.0, 'roundhi': 1.0, 'brightest': 200, 'peakmax': None, 'bkg_boxsize': 400, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 2.0, 'use2dhist': False, 'separation': 1.0, 'tolerance': 0.7, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'shift', 'nclip': 3, 'sigma': 3, 'abs_refcat': '', 'save_abs_catalog': False, 'abs_minobj': 15, 'abs_searchrad': 6.0, 'abs_use2dhist': True, 'abs_separation': 0.1, 'abs_tolerance': 0.7, 'abs_fitgeometry': 'rshift', 'abs_nclip': 3, 'abs_sigma': 3.0}, 'skymatch': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '~DO_NOT_USE+NON_SCIENCE', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}, 'outlier_detection': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None, 'in_memory': False}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}, 'source_catalog': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 1000, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 25, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}}}
2022-10-06 05:34:14,474 - stpipe.Image3Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits' reftypes = ['abvegaoffset', 'apcorr', 'drizpars']
2022-10-06 05:34:14,491 - stpipe.Image3Pipeline - INFO - Prefetch for ABVEGAOFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf'.
2022-10-06 05:34:14,492 - stpipe.Image3Pipeline - INFO - Prefetch for APCORR reference file is '/grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits'.
2022-10-06 05:34:14,494 - stpipe.Image3Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-10-06 05:34:14,495 - stpipe.Image3Pipeline - INFO - Starting calwebb_image3 ...
2022-10-06 05:34:15,692 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg running with args (<ModelContainer>,).
2022-10-06 05:34:15,694 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': False, 'catalog_format': 'ecsv', 'kernel_fwhm': 3.318, 'snr_threshold': 50, 'sharplo': 0.2, 'sharphi': 1.0, 'roundlo': -1.0, 'roundhi': 1.0, 'brightest': 200, 'peakmax': None, 'bkg_boxsize': 400, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 2.0, 'use2dhist': False, 'separation': 1.0, 'tolerance': 0.7, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'shift', 'nclip': 3, 'sigma': 3, 'abs_refcat': '', 'save_abs_catalog': False, 'abs_minobj': 15, 'abs_searchrad': 6.0, 'abs_use2dhist': True, 'abs_separation': 0.1, 'abs_tolerance': 0.7, 'abs_fitgeometry': 'rshift', 'abs_nclip': 3, 'abs_sigma': 3.0}
2022-10-06 05:34:15,834 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 98 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits.
2022-10-06 05:34:15,961 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 98 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits.
2022-10-06 05:34:16,084 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 102 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits.
2022-10-06 05:34:16,206 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 103 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits.
2022-10-06 05:34:16,328 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 86 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits.
2022-10-06 05:34:16,450 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 88 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits.
2022-10-06 05:34:16,574 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 83 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits.
2022-10-06 05:34:16,697 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 83 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits.
2022-10-06 05:34:16,719 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:16,720 - stpipe.Image3Pipeline.tweakreg - INFO - Number of image groups to be aligned: 8.
2022-10-06 05:34:16,720 - stpipe.Image3Pipeline.tweakreg - INFO - Image groups:
2022-10-06 05:34:16,744 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal':
2022-10-06 05:34:16,744 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal
2022-10-06 05:34:16,770 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal':
2022-10-06 05:34:16,771 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal
2022-10-06 05:34:16,793 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal':
2022-10-06 05:34:16,793 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal
2022-10-06 05:34:16,817 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal':
2022-10-06 05:34:16,817 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal
2022-10-06 05:34:16,839 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal':
2022-10-06 05:34:16,840 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal
2022-10-06 05:34:16,863 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal':
2022-10-06 05:34:16,863 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal
2022-10-06 05:34:16,886 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal':
2022-10-06 05:34:16,886 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal
2022-10-06 05:34:16,909 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal':
2022-10-06 05:34:16,910 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal
2022-10-06 05:34:16,910 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:16,910 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:16,911 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() started on 2022-10-06 05:34:16.910882
2022-10-06 05:34:16,911 - stpipe.Image3Pipeline.tweakreg - INFO - Version 0.8.0
2022-10-06 05:34:16,912 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:17,102 - stpipe.Image3Pipeline.tweakreg - INFO - Selected image 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' as reference image
2022-10-06 05:34:17,107 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-10-06 05:34:17,228 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:34:17,229 - stpipe.Image3Pipeline.tweakreg - INFO - Found 59 matches for 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal'...
2022-10-06 05:34:17,230 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:34:17,232 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal:
2022-10-06 05:34:17,232 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: 4.20853e-05 YSH: -9.17984e-05
2022-10-06 05:34:17,233 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:17,233 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.0010652 FIT MAE: 0.000864669
2022-10-06 05:34:17,233 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 55 objects.
2022-10-06 05:34:17,270 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-10-06 05:34:17,393 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:34:17,394 - stpipe.Image3Pipeline.tweakreg - INFO - Found 55 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal'...
2022-10-06 05:34:17,395 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:34:17,397 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal:
2022-10-06 05:34:17,397 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0322701 YSH: 0.0518525
2022-10-06 05:34:17,398 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:17,398 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.437425 FIT MAE: 0.338878
2022-10-06 05:34:17,398 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 55 objects.
2022-10-06 05:34:17,435 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-10-06 05:34:17,555 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:34:17,557 - stpipe.Image3Pipeline.tweakreg - INFO - Found 55 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal'...
2022-10-06 05:34:17,558 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:34:17,559 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal:
2022-10-06 05:34:17,560 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0326498 YSH: 0.0518036
2022-10-06 05:34:17,560 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:17,561 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.437465 FIT MAE: 0.338874
2022-10-06 05:34:17,561 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 55 objects.
2022-10-06 05:34:17,596 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-10-06 05:34:17,720 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:34:17,721 - stpipe.Image3Pipeline.tweakreg - INFO - Found 48 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal'...
2022-10-06 05:34:17,722 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:34:17,724 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal:
2022-10-06 05:34:17,724 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0249288 YSH: -0.00722079
2022-10-06 05:34:17,725 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:17,725 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.494393 FIT MAE: 0.401721
2022-10-06 05:34:17,725 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 48 objects.
2022-10-06 05:34:17,760 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-10-06 05:34:18,090 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:34:18,091 - stpipe.Image3Pipeline.tweakreg - INFO - Found 47 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal'...
2022-10-06 05:34:18,092 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:34:18,094 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal:
2022-10-06 05:34:18,094 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.025274 YSH: -0.0232561
2022-10-06 05:34:18,094 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:18,095 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.472396 FIT MAE: 0.371671
2022-10-06 05:34:18,095 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 47 objects.
2022-10-06 05:34:18,129 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-10-06 05:34:18,251 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:34:18,252 - stpipe.Image3Pipeline.tweakreg - INFO - Found 46 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal'...
2022-10-06 05:34:18,253 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:34:18,255 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal:
2022-10-06 05:34:18,255 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0272563 YSH: 0.0241337
2022-10-06 05:34:18,255 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:18,256 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.392161 FIT MAE: 0.270689
2022-10-06 05:34:18,256 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 46 objects.
2022-10-06 05:34:18,291 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-10-06 05:34:18,412 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:34:18,414 - stpipe.Image3Pipeline.tweakreg - INFO - Found 46 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal'...
2022-10-06 05:34:18,415 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:34:18,417 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal:
2022-10-06 05:34:18,417 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0278693 YSH: 0.0256817
2022-10-06 05:34:18,417 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:18,418 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.412239 FIT MAE: 0.295567
2022-10-06 05:34:18,418 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 46 objects.
2022-10-06 05:34:18,453 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:18,454 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() ended on 2022-10-06 05:34:18.453597
2022-10-06 05:34:18,454 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() TOTAL RUN TIME: 0:00:01.542715
2022-10-06 05:34:18,455 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:34:18,613 - stpipe.Image3Pipeline.tweakreg - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:34:18,624 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:34:18,624 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:34:18,729 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:34:18,729 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:34:18,833 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:34:18,833 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:34:18,939 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:34:18,940 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:34:19,144 - stpipe.Image3Pipeline.tweakreg - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:34:19,155 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:34:19,156 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:34:19,259 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:34:19,260 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:34:19,271 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg done
2022-10-06 05:34:19,502 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch running with args (<ModelContainer>,).
2022-10-06 05:34:19,504 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '~DO_NOT_USE+NON_SCIENCE', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}
2022-10-06 05:34:19,728 - stpipe.Image3Pipeline.skymatch - INFO -
2022-10-06 05:34:19,729 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() started on 2022-10-06 05:34:19.728827
2022-10-06 05:34:19,730 - stpipe.Image3Pipeline.skymatch - INFO -
2022-10-06 05:34:19,730 - stpipe.Image3Pipeline.skymatch - INFO - Sky computation method: 'match'
2022-10-06 05:34:19,731 - stpipe.Image3Pipeline.skymatch - INFO - Sky matching direction: DOWN
2022-10-06 05:34:19,731 - stpipe.Image3Pipeline.skymatch - INFO - Sky subtraction from image data: OFF
2022-10-06 05:34:19,731 - stpipe.Image3Pipeline.skymatch - INFO -
2022-10-06 05:34:19,732 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing differences in sky values in overlapping regions.
2022-10-06 05:34:31,310 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.00819783
2022-10-06 05:34:31,310 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.00435007
2022-10-06 05:34:31,311 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0227094
2022-10-06 05:34:31,311 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0128405
2022-10-06 05:34:31,311 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0054264
2022-10-06 05:34:31,312 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0154107
2022-10-06 05:34:31,312 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.00232743
2022-10-06 05:34:31,312 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0
2022-10-06 05:34:31,313 - stpipe.Image3Pipeline.skymatch - INFO -
2022-10-06 05:34:31,313 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() ended on 2022-10-06 05:34:31.313147
2022-10-06 05:34:31,313 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() TOTAL RUN TIME: 0:00:11.584320
2022-10-06 05:34:31,314 - stpipe.Image3Pipeline.skymatch - INFO -
2022-10-06 05:34:31,346 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch done
2022-10-06 05:34:31,539 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection running with args (<ModelContainer>,).
2022-10-06 05:34:31,541 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'crf', 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None, 'in_memory': False}
2022-10-06 05:34:31,547 - stpipe.Image3Pipeline.outlier_detection - INFO - Performing outlier detection on 8 inputs
2022-10-06 05:34:31,548 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter kernel: square
2022-10-06 05:34:31,548 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:34:31,548 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter fillval: INDEF
2022-10-06 05:34:31,549 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter weight_type: ivm
2022-10-06 05:34:31,732 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:34:32,325 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:34:32,609 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-10-06 05:34:32,614 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:34:33,362 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:34:33,642 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-10-06 05:34:33,646 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:34:34,405 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:34:34,688 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-10-06 05:34:34,693 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:34:35,450 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:34:35,732 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-10-06 05:34:35,737 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:34:36,526 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:34:36,804 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-10-06 05:34:36,809 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:34:37,559 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:34:37,832 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-10-06 05:34:37,836 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:34:38,593 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:34:38,866 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-10-06 05:34:38,870 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:34:39,615 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:34:39,894 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-10-06 05:34:45,090 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting median...
2022-10-06 05:34:45,180 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:34:45,754 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-10-06 05:34:46,042 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:34:46,773 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-10-06 05:34:47,095 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:34:47,871 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-10-06 05:34:48,186 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:34:48,931 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-10-06 05:34:49,253 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:34:50,000 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-10-06 05:34:50,331 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:34:51,093 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-10-06 05:34:51,652 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:34:52,383 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-10-06 05:34:52,702 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:34:53,453 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1118)
2022-10-06 05:34:53,664 - stpipe.Image3Pipeline.outlier_detection - INFO - Flagging outliers
2022-10-06 05:34:53,832 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:34:53,852 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:34:53,868 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 638 (0.06%)
2022-10-06 05:34:54,062 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:34:54,080 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:34:54,094 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 663 (0.06%)
2022-10-06 05:34:54,285 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:34:54,304 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:34:54,318 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 863 (0.08%)
2022-10-06 05:34:54,510 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:34:54,529 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:34:54,543 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 848 (0.08%)
2022-10-06 05:34:54,733 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:34:54,752 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:34:54,766 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 528 (0.05%)
2022-10-06 05:34:55,178 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:34:55,197 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:34:55,210 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 606 (0.06%)
2022-10-06 05:34:55,402 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:34:55,420 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:34:55,433 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 462 (0.04%)
2022-10-06 05:34:55,627 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:34:55,646 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:34:55,658 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 454 (0.04%)
2022-10-06 05:34:55,920 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-10-06 05:34:56,192 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-10-06 05:34:56,465 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-10-06 05:34:56,730 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-10-06 05:34:56,997 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-10-06 05:34:57,270 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-10-06 05:34:57,534 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-10-06 05:34:57,800 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-10-06 05:34:57,801 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection done
2022-10-06 05:34:58,003 - stpipe.Image3Pipeline.resample - INFO - Step resample running with args (<ModelContainer>,).
2022-10-06 05:34:58,005 - stpipe.Image3Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 1.0, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-10-06 05:34:58,025 - stpipe.Image3Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-10-06 05:34:58,048 - stpipe.Image3Pipeline.resample - INFO - Driz parameter kernel: square
2022-10-06 05:34:58,048 - stpipe.Image3Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:34:58,048 - stpipe.Image3Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-10-06 05:34:58,049 - stpipe.Image3Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-10-06 05:34:58,219 - stpipe.Image3Pipeline.resample - INFO - Blending metadata for starfield_50star4ptdither_combined.fits
2022-10-06 05:34:58,847 - stpipe.Image3Pipeline.resample - INFO - Resampling science data
2022-10-06 05:34:59,424 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:00,340 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:01,246 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:02,157 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:03,063 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:03,980 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:04,887 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:05,806 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:05,984 - stpipe.Image3Pipeline.resample - INFO - Resampling var_rnoise
2022-10-06 05:35:06,565 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:07,497 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:08,440 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:09,376 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:10,301 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:11,272 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:12,201 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:13,144 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:13,333 - stpipe.Image3Pipeline.resample - INFO - Resampling var_poisson
2022-10-06 05:35:13,906 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:14,821 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:15,728 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:16,642 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:17,562 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:18,487 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:19,419 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:20,366 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:20,555 - stpipe.Image3Pipeline.resample - INFO - Resampling var_flat
2022-10-06 05:35:21,160 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:22,120 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:23,096 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:24,053 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:25,038 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:25,995 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:26,950 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:27,941 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1118)
2022-10-06 05:35:28,127 - stpipe.Image3Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:308: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-10-06 05:35:28,169 - stpipe.Image3Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021871916 -0.020269197 0.024945365 0.014753477 359.990658717 0.017762336 359.987585268 -0.017260339
2022-10-06 05:35:28,623 - stpipe.Image3Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_combined_i2d.fits
2022-10-06 05:35:28,624 - stpipe.Image3Pipeline.resample - INFO - Step resample done
2022-10-06 05:35:28,858 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog running with args (<ImageModel(1142, 1118) from starfield_50star4ptdither_combined_i2d.fits>,).
2022-10-06 05:35:28,859 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 1000, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 25, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}
2022-10-06 05:35:28,876 - stpipe.Image3Pipeline.source_catalog - INFO - Using APCORR reference file: /grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits
2022-10-06 05:35:28,887 - stpipe.Image3Pipeline.source_catalog - INFO - Using ABVEGAOFFSET reference file: /grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf
2022-10-06 05:35:28,887 - stpipe.Image3Pipeline.source_catalog - INFO - Instrument: MIRI
2022-10-06 05:35:28,888 - stpipe.Image3Pipeline.source_catalog - INFO - Detector: MIRIMAGE
2022-10-06 05:35:28,888 - stpipe.Image3Pipeline.source_catalog - INFO - Filter: F1130W
2022-10-06 05:35:28,888 - stpipe.Image3Pipeline.source_catalog - INFO - Subarray: FULL
2022-10-06 05:35:28,955 - stpipe.Image3Pipeline.source_catalog - INFO - AB to Vega magnitude offset 5.49349
2022-10-06 05:35:29,039 - stpipe.Image3Pipeline.source_catalog - INFO - Background could not be estimated in meshes. Using the entire unmasked array for background estimation: bkg_boxsize=(1142, 1118).
2022-10-06 05:35:29,274 - stpipe.Image3Pipeline.source_catalog - INFO - Detected 285 sources
2022-10-06 05:35:29,634 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote source catalog: starfield_50star4ptdither_combined_cat.ecsv
2022-10-06 05:35:29,764 - stpipe.Image3Pipeline.source_catalog - INFO - Saved model in starfield_50star4ptdither_combined_segm.fits
2022-10-06 05:35:29,765 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote segmentation map: starfield_50star4ptdither_combined_segm.fits
2022-10-06 05:35:29,766 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog done
2022-10-06 05:35:29,768 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline done
Image 3 pipeline finished.
The output of the pipeline command in the previous step (given our association table) is an i2d.fits file. This file is in the format of a JWST Data model type of DrizProductModel and should be opened as such. It is this file that we will use for source finding and to determine whether the stars are found in the expected locations. The i2d file and the associated text file containing the input coordinates of the stars can be found in artifactory.
# Read in the combined data file and list of coordinates
im = ImageModel('starfield_50star4ptdither_combined_i2d.fits')
pixarea = im.meta.photometry.pixelarea_steradians
print('Pixel area in steradians', pixarea)
coords = get_bigdata('jwst_validation_notebooks',
'validation_data',
'resample',
'resample_miri_test',
'radec_4ptdith_50star_mosaic_coords.txt')
# read in text file with RA and Dec input coordinates
RA_in, Dec_in = np.loadtxt( coords, dtype=str, unpack=True)
# put RA and Dec into floats
RA_sim = RA_in.astype(float)
Dec_sim = Dec_in.astype(float)
# pull out data portion of input file
data = im.data
# print stats on input image
mean, median, std = sigma_clipped_stats(data, sigma=200.0, maxiters=5) # default sigma=3
print('Image mean, median and std',mean, median, std)
Pixel area in steradians 2.84403609523084e-13 Image mean, median and std 10.161678 10.829916 46.34863
The block of code below will find the sources in the image, create apertures for each source found, and output the table of x, y coordinates along with the peak pixel value. It will also show a scaled version of the image and mark in blue the positions of sources found.
# Run DAOStarFinder to find sources in image
ap_radius = 5. # radius for aperture for centroiding and photometry
daofind = DAOStarFinder(fwhm=3.0, threshold=10.*std) # default threshold=5*std, fwhm=3
sources = daofind(data)
sources.pprint_all()
#print(sources['xcentroid','ycentroid','peak'])
# Create apertures for x,y positions
positions = tuple(zip(sources['xcentroid'], sources['ycentroid']))
#print(positions)
#positions = (sources['xcentroid'], sources['ycentroid'])
apertures = CircularAperture(positions, r=ap_radius)
id xcentroid ycentroid sharpness roundness1 roundness2 npix sky peak flux mag --- ------------------ ------------------ ------------------- ------------- --------------------- ---- --- ----------------- ------------------ ------------------- 1 695.4768873849597 123.09345386140679 0.48122706472371624 -0.17843401 -0.05705847396235437 25 0.0 2739.67822265625 4.01121711730957 -1.5081904247730562 2 772.5497139436839 126.62722936100566 0.4333626131459059 0.15296648 -0.04009332036251727 25 0.0 2677.057373046875 4.179043769836426 -1.5526922995382264 3 973.4985485352782 151.87781319201048 0.4066066427984635 -0.13043086 -0.061746689981988935 25 0.0 2654.71630859375 4.21962833404541 -1.5631854996899626 4 1040.9504131057192 156.51763105193604 0.4872309401759817 0.037374333 0.05112374597978539 25 0.0 2857.69091796875 4.2113037109375 -1.5610414075330612 5 531.5670391216789 183.2162491709291 0.45203022174209256 -0.14403123 -0.02439307096598126 25 0.0 2753.0380859375 4.094959735870361 -1.5306240896762036 6 795.7620600240112 192.6182172262258 0.46235349582475227 0.16743168 0.08347443950251698 25 0.0 2767.837646484375 4.092608451843262 -1.530000491995539 7 460.94604927202033 204.17190011221226 0.40952241832563374 -0.017137332 0.016104688986099187 25 0.0 2849.06396484375 4.571038722991943 -1.6500372509429129 8 516.4969163945225 217.77212688417637 0.4512472719574508 -0.14851701 -0.052562226922077904 25 0.0 2687.934326171875 3.984842300415039 -1.5010278473198313 9 573.6221794709099 231.4100315182614 0.4308801584782885 -0.12234023 0.06134040474576186 25 0.0 2709.18798828125 4.085455417633057 -1.5281011890993184 10 900.309094984966 253.64419081101315 0.4366954518113767 -0.086376734 0.06809401967183798 25 0.0 2710.171142578125 4.141601085662842 -1.542920664545108 11 637.6482832893241 262.5307391763159 0.4358883579952844 0.19806434 0.06332808414914848 25 0.0 2640.3671875 4.034980297088623 -1.5146035459806753 12 944.2048398946808 281.46591784704935 0.44499460343232133 0.12957999 0.0408836312127665 25 0.0 2679.60302734375 4.139435291290283 -1.5423527449493175 13 1030.9747765436073 282.04190933691 0.42623314059408807 0.08142971 0.06939795331858852 25 0.0 2825.080810546875 4.5303544998168945 -1.6403304671129755 14 466.96913724653365 295.8715341375182 0.41508643598904565 0.028083714 0.05469089311679108 25 0.0 2777.38671875 4.4780802726745605 -1.62772968585158 15 478.61115540256316 302.33109251484547 0.42973271510276184 -0.16943383 0.013347137366053273 25 0.0 2677.8603515625 4.195261001586914 -1.5568974623890905 16 552.4590815148299 313.1919448179232 0.4430090893804968 0.0924202 -0.020522883333791438 25 0.0 2691.052978515625 4.142690658569336 -1.5432062625891287 17 794.0674433034542 323.46192876360124 0.4423851084793877 0.16308336 0.1456068704891493 25 0.0 2756.639404296875 4.205136775970459 -1.5594503154853503 18 558.6884806627603 327.97869192482705 0.39852836227679755 -0.003484431 -0.003761498710130047 25 0.0 2698.655517578125 4.456071853637695 -1.6223804629247067 19 936.2473621610417 341.98780122154255 0.4494268190954719 0.027999135 0.05840971854890569 25 0.0 2847.976318359375 4.408660411834717 -1.6107666187225234 20 804.9596434356149 356.5707403384509 0.4084140067614061 0.02062765 0.12065375309896494 25 0.0 2641.110595703125 4.263513565063477 -1.574419122750533 21 443.935719718374 380.0565121241753 0.43846849171191066 0.004864283 0.031022200659039094 25 0.0 2858.578857421875 4.480772972106934 -1.6283823500420551 22 728.6328780321769 405.6017067903938 0.43021574161322734 0.17921092 -0.1864117098389245 25 0.0 4888.927734375 7.693710803985596 -2.21533964436236 23 784.4852062369392 429.2849368872163 0.46726685767065895 0.18001758 0.017060911991662875 25 0.0 2747.728759765625 4.094724655151367 -1.5305617586667197 24 622.5433605057979 469.35512840242006 0.4647816855519927 -0.22607529 -0.019231953092052133 25 0.0 2718.32421875 3.9805209636688232 -1.4998497887522377 25 520.7083458664933 537.9966789192111 0.41412499681880177 -0.018454138 0.00359237678189744 25 0.0 2772.4677734375 4.525998115539551 -1.6392859219859344 26 753.3806399321455 562.4266715925112 0.452446195205066 0.21440639 0.07887419809196484 25 0.0 2676.755126953125 3.9872660636901855 -1.5016880409600786 27 792.7290023215829 572.5789972194619 0.4193441079638208 0.16590807 0.10221928619326233 25 0.0 2630.01220703125 4.10445499420166 -1.5331387448538458 28 486.01615084341427 575.0138066374245 0.4093437439177251 0.04381405 0.06383725022526653 25 0.0 2771.536865234375 4.514009475708008 -1.6364061660099742 29 758.3755458940878 586.9264220934097 0.4111986177545858 -0.09126295 -0.020614693862750427 25 0.0 2721.006591796875 4.388582229614258 -1.6058106005466937 30 398.7252022376796 626.1795169001109 0.42115179388709373 -0.010608349 0.008266441393530749 25 0.0 2753.684326171875 4.400387763977051 -1.6087273709514869 31 944.3508085628226 671.7327461837529 0.46425683445459504 -0.1613553 0.011596209870324095 25 0.0 2805.35205078125 4.170652389526367 -1.5505099857620175 32 977.9991772171035 681.149592090182 0.3919723898428933 -0.07912512 -0.012122398463573113 25 0.0 2771.753173828125 4.693727493286133 -1.6787946797107833 33 1058.4903567526735 696.7262171292342 0.4677683780235676 0.10364849 -0.016975901750322445 25 0.0 2695.183349609375 4.01188325881958 -1.5083707176580172 34 857.4824924508858 705.4193214543063 0.4676280815235846 0.25801313 0.04608157877295311 25 0.0 2689.0 3.8722076416015625 -1.4698965942044662 35 902.7774192685463 739.2833881827175 0.42061156309652104 -0.09639728 0.04777629503441706 25 0.0 2733.49169921875 4.304750442504883 -1.5848699483681663 36 546.9539941551182 815.9811404687127 0.42993493583685716 0.00010692607 0.0025937213871562374 25 0.0 2854.040283203125 4.517554759979248 -1.6372585640191575 37 752.0069651793241 846.8565327976801 0.41300361048326606 -0.024561219 0.02812427548687811 25 0.0 2833.377685546875 4.626048564910889 -1.6630254693582815 38 1042.5524129523935 848.7935281885725 0.45347147664699183 0.016649505 -0.045308815639865295 25 0.0 2774.169189453125 4.184135437011719 -1.5540143346019493 39 849.4878994720676 856.6755092405767 0.45500538805047214 0.10036823 -0.05885631567358064 25 0.0 2687.703369140625 4.0496134757995605 -1.5185339325192304 40 565.6638996843259 907.4396582447206 0.44134257942476063 0.23155753 0.07347975065206847 25 0.0 2646.056396484375 4.056945323944092 -1.5204978867310006 41 907.2832725420959 964.4267603275954 0.4547212445121062 0.16346736 0.056982205100822414 25 0.0 2740.101318359375 4.180441856384277 -1.5530554685810152 42 862.4202240520881 970.7299016306779 0.44253311109178467 0.06400786 -0.0855558126314827 25 0.0 2761.790771484375 4.204267978668213 -1.5592259750673247 43 908.0646563701695 979.5856333752163 0.45362356328462333 -0.025468294 0.03844432201318057 25 0.0 2818.203857421875 4.446091175079346 -1.6199459111052714 44 898.0908473101824 1024.5763199653786 0.4405980104981531 0.13201416 0.14005909502158712 25 0.0 2696.22802734375 4.14641809463501 -1.5441827276544817 45 1065.204616724153 1024.0860229913724 0.4076933383048138 -0.029189145 0.008703365877059327 25 0.0 2833.987060546875 4.625576496124268 -1.6629146688946153 46 885.7802289652379 1035.3565019053842 0.4646835243274934 -0.10924987 0.06343981855265289 25 0.0 2831.0576171875 4.283621311187744 -1.579527676331578 47 844.633490765497 1037.1253556255858 0.4199790925611236 -0.14990568 -0.03384865774120933 25 0.0 2808.513916015625 4.554217338562012 -1.646034380962365 48 983.3376890371602 1053.1813752305072 0.4485008602820098 0.013301602 -0.02737905573037175 25 0.0 2858.863037109375 4.393416881561279 -1.6070060361462928 49 716.705035791758 1093.54361922369 0.4285509855931338 -0.16045043 0.05060286813869858 25 0.0 2605.2177734375 4.114713191986084 -1.5358489223951544 50 546.9564287152346 1106.9809502324074 0.38228237487668865 0.0035719695 0.03474351306532602 25 0.0 2780.930908203125 4.757469177246094 -1.693439958138422
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(data, cmap='Greys', origin='lower', vmin=8,vmax=15)#, norm=norm)
apertures.plot(color='red', lw=2.5) #, alpha=0.5)
plt.show()
Set a specified annulus (inner and outer radii for the annulus).
Run photometry on aperture and annuli.
Subtract background values in annulus from aperture photometry.
Output should be a table of photometry values printed to the screen (full table has columns id, xcenter, ycenter, aperture_sum and the added columns annulus_median, aperture_bkg and aperture_sum_bkgsub). You can choose which columns you wish to see printed.
# set values for inner and outer annuli to collect background counts
inner_annulus = 10.
outer_annulus = 15.
# set up annulus for background
background_aper = CircularAnnulus(positions, r_in=inner_annulus, r_out=outer_annulus)
# perform photometry on apertures for targets and background annuli
phot_table = aperture_photometry(im.data, apertures)
# perform background subtraction with outlier rejection
bkg_median = []
bkg_mask = background_aper.to_mask(method='center')
bmask = bkg_mask[0]
for mask in bkg_mask:
aper_data = bmask.multiply(data)
aper_data = aper_data[mask.data > 0]
# perform sigma-clipped median
_, median_sigclip, _ = sigma_clipped_stats(aper_data)
bkg_median.append(median_sigclip)
bkg_median = np.array(bkg_median)
# do calculations on background regions found in annuli
# Get average background per pixel
phot_table['annulus_median'] = bkg_median
# Get total background in the science aperture (per pixel * area in aperture)
phot_table['aperture_bkg'] = bkg_median * apertures.area
# subtract background in aperture from flux in aperture
phot_table['aperture_sum_bkgsub'] = phot_table['aperture_sum'] - phot_table['aperture_bkg']
# put aperture sum in pixel scale
phot_table['scaled_ap_sum_bkgsub'] = phot_table['aperture_sum_bkgsub'] * pixarea
#print(phot_table['aperture_sum','annulus_median','aperture_bkg','aperture_sum_bkgsub','scaled_ap_sum_bkgsub'])
phot_table_sub = phot_table['aperture_sum','annulus_median','aperture_bkg','aperture_sum_bkgsub','scaled_ap_sum_bkgsub']
phot_table_sub.pprint_all()
aperture_sum annulus_median aperture_bkg aperture_sum_bkgsub scaled_ap_sum_bkgsub ------------------ ------------------ ------------------ ------------------- ---------------------- 36846.980686608986 14.93050765991211 1172.6393294686504 35674.341357140336 1.0145911449329346e-08 37069.371547282 14.539774894714355 1141.9512498520983 35927.4202974299 1.0217888013441974e-08 37146.21669492824 14.903438568115234 1170.5133279704403 35975.7033669578 1.0231619892694566e-08 37299.3444963277 14.715289115905762 1155.7361045494847 36143.608391778216 1.0279372687810554e-08 37763.247353303275 14.600446701049805 1146.716402378685 36616.53095092459 1.0413873570656677e-08 37583.06609537285 14.600446701049805 1146.716402378685 36436.34969299417 1.0362629370532855e-08 38118.595840084534 14.77898120880127 1160.7384698277917 36957.857370256745 1.0510948036340331e-08 37312.37813455113 14.87005615234375 1167.8914791667708 36144.48665538436 1.0279622469150255e-08 38156.35264782475 14.629406929016113 1148.9909333643159 37007.361714460436 1.0525027250518935e-08 37130.692711588315 14.822688579559326 1164.1712386998227 35966.52147288849 1.0229008528878994e-08 37223.516384749535 14.539774894714355 1141.9512498520983 36081.565134897435 1.0261727361607092e-08 36437.58905406709 14.903438568115234 1170.5133279704403 35267.07572609665 1.0030083633825825e-08 37301.496529897544 14.822688579559326 1164.1712386998227 36137.32529119772 1.0277585751326464e-08 37491.42152713229 14.765673637390137 1159.6932956132334 36331.72823151905 1.0332874649255752e-08 36961.413179723175 14.722012519836426 1156.264159459377 35805.149020263794 1.0183113620874937e-08 37233.0710684976 14.947773456573486 1173.9953819673945 36059.0756865302 1.0255331281315268e-08 37787.74089542015 14.888280868530273 1169.3228450289043 36618.41805039125 1.0414410268556524e-08 37137.069867637285 14.672348022460938 1152.3635189569004 35984.70634868038 1.0234180373192938e-08 37625.833914222734 14.903438568115234 1170.5133279704403 36455.320586252295 1.0368024761051344e-08 36853.555008129355 14.72873592376709 1156.7922143692692 35696.762793760085 1.0152288186834696e-08 37327.16583071833 14.77898120880127 1160.7384698277917 36166.42736089054 1.0285862484991696e-08 66779.99994698925 14.5987229347229 1146.5810180879573 65633.41892890129 1.8666381248720232e-08 37490.57145073713 14.956778526306152 1174.7026384903245 36315.86881224681 1.0328364173169785e-08 37318.08615760276 14.5987229347229 1146.5810180879573 36171.505139514804 1.0287306623560794e-08 37128.92534824998 14.72873592376709 1156.7922143692692 35972.13313388071 1.02306045055206e-08 37231.63779838171 14.903438568115234 1170.5133279704403 36061.12447041127 1.0255913962846175e-08 36698.26701338696 14.629406929016113 1148.9909333643159 35549.276080022646 1.0110342433091072e-08 36911.59046360523 14.87005615234375 1167.8914791667708 35743.69898443846 1.0165637008880889e-08 37129.02909713025 14.888280868530273 1169.3228450289043 35959.70625210135 1.0227070255487435e-08 37044.467652646534 14.672348022460938 1152.3635189569004 35892.10413368963 1.0207843968999735e-08 37440.80429091896 14.852836608886719 1166.5390593862014 36274.26523153276 1.0316531964645624e-08 37008.79169514841 14.792540550231934 1161.8034180134441 35846.988277134966 1.0195012856548863e-08 36695.985667090295 14.852836608886719 1166.5390593862014 35529.44660770409 1.0104702859588736e-08 37528.969931666215 14.822688579559326 1164.1712386998227 36364.79869296639 1.0342280007859969e-08 37322.068613158575 14.740135192871094 1157.687510871105 36164.38110228747 1.0285280521658964e-08 37600.11288760824 14.765673637390137 1159.6932956132334 36440.419591995 1.0363786864499087e-08 37283.36118442455 14.765673637390137 1159.6932956132334 36123.66788881132 1.0273701536791062e-08 37282.8255703648 14.572257041931152 1144.502391728826 36138.323178635976 1.0277869554115803e-08 36925.297563699154 14.822688579559326 1164.1712386998227 35761.12632499933 1.0170593407440789e-08 36957.6453626113 14.722012519836426 1156.264159459377 35801.38120315192 1.0182042040088298e-08 37242.214876755934 14.895859718322754 1169.9180864996722 36072.29679025626 1.0259091410936837e-08 37934.51890167325 14.887275695800781 1169.2438989473403 36765.27500272591 1.0456176915884061e-08 36880.19993687115 14.729589462280273 1156.8592511273334 35723.34068574382 1.0159847035248385e-08 37297.07050648542 14.72873592376709 1156.7922143692692 36140.27829211615 1.027842559544659e-08 37808.81778414099 15.025341033935547 1180.0875252473295 36628.730258893665 1.0417343097876766e-08 37459.76697611657 14.746250629425049 1158.16781613489 36301.59915998168 1.0324305832558942e-08 37758.49967929367 14.614926815032959 1147.8536678715004 36610.64601142217 1.0412199872620363e-08 37946.82731674766 14.966246604919434 1175.446259645702 36771.38105710196 1.0457913499788553e-08 36003.818293373 14.614926815032959 1147.8536678715004 34855.964625501496 9.913162152901556e-09 37362.164025613376 14.765673637390137 1159.6932956132334 36202.47073000014 1.0296113349265838e-08
The output of the next block of code should be a table showing the x and y centroid positions as well as the associated RA and Dec values.
# using wcs info from images, put coordinates into RA, Dec
ra, dec = im.meta.wcs(sources['xcentroid'], sources['ycentroid'])
# add RA, Dec to sources table
ra_col = Column(name='RA', data=ra)
dec_col = Column(name='Dec', data=dec)
sources.add_column(ra_col)
sources.add_column(dec_col)
# print RA, Dec for each x, y position found
#print(sources['xcentroid', 'ycentroid', 'RA', 'Dec'])
sources_sub = sources['xcentroid', 'ycentroid', 'RA', 'Dec']
sources_sub.pprint_all()
# add option to print out list of sources with flux values
outtable = 'sourcelist_phot_rate.txt'
sources.add_column(phot_table['aperture_sum'])
sources.add_column(phot_table['aperture_sum_bkgsub'])
sources.add_column(phot_table['scaled_ap_sum_bkgsub'])
xcentroid ycentroid RA Dec ------------------ ------------------ --------------------- ----------------------- 695.4768873849597 123.09345386140679 0.0008744196286825949 -0.014622459880034746 772.5497139436839 126.62722936100566 359.9985202726622 -0.014306661462618709 973.4985485352782 151.87781319201048 359.99242556199556 -0.012991469340025985 1040.9504131057192 156.51763105193604 359.99036944597395 -0.012667643711837574 531.5670391216789 183.2162491709291 0.006062988925558933 -0.01321975197076472 795.7620600240112 192.6182172262258 359.9979860007638 -0.012220389179595842 460.94604927202033 204.17190011221226 0.008285180075728076 -0.012767148706877365 516.4969163945225 217.77212688417637 0.006618156878560576 -0.012200555784181426 573.6221794709099 231.4100315182614 0.004902951754196733 -0.01162857019855531 900.309094984966 253.64419081101315 359.99494400714025 -0.010067488089100001 637.6482832893241 262.5307391763159 0.003023163969010448 -0.010501852604429804 944.2048398946808 281.46591784704935 359.9936726956075 -0.009096119666750876 1030.9747765436073 282.04190933691 359.99101319906885 -0.008844932360097823 466.96913724653365 295.8715341375182 0.008347254985564781 -0.009938708906664451 478.61115540256316 302.33109251484547 0.00800760391823967 -0.00970927617616864 552.4590815148299 313.1919448179232 0.0057720769347741445 -0.009177451309850626 794.0674433034542 323.46192876360124 359.9983901089874 -0.008212255549923227 558.6884806627603 327.97869192482705 0.005620830075757535 -0.008707208570019123 936.2473621610417 341.98780122154255 359.99407961603754 -0.007261459952228881 804.9596434356149 356.5707403384509 359.99814517401813 -0.007167565677593685 443.935719718374 380.0565121241753 0.009280206165698952 -0.007418926746034492 728.6328780321769 405.6017067903938 0.0006179076965442313 -0.005869308951941822 784.4852062369392 429.2849368872163 359.99896877561963 -0.004992680704553806 622.5433605057979 469.35512840242006 0.004043023171865855 -0.004199646359951366 520.7083458664933 537.9966789192111 0.007350817586764152 -0.0023686252796982815 753.3806399321455 562.4266715925112 0.000281008205300254 -0.0009932221636927586 792.7290023215829 572.5789972194619 359.9991016016198 -0.0005759744945086386 486.01615084341427 575.0138066374245 0.008514376110352861 -0.001326756449302307 758.3755458940878 586.9264220934097 0.0001937610727692437 -0.00022842492600235316 398.7252022376796 626.1795169001109 0.011329102864773668 7.460554784815031e-06 944.3508085628226 671.7327461837529 359.9947185391059 0.002872914895855278 977.9991772171035 681.149592090182 359.9937119596805 0.00325226664837558 1058.4903567526735 696.7262171292342 359.9912853900897 0.003946592951752243 857.4824924508858 705.4193214543063 359.99747326319255 0.0036722219588407887 902.7774192685463 739.2833881827175 359.9961753034242 0.004832661466119555 546.9539941551182 815.9811404687127 0.007294056110670084 0.006227193236190696 752.0069651793241 846.8565327976801 0.0010886182403909014 0.007725931272136276 1042.5524129523935 848.7935281885725 359.9921834291972 0.008567275679764074 849.4878994720676 856.6755092405767 359.9981255139278 0.008289407210184849 565.6638996843259 907.4396582447206 0.006966404773145784 0.009082382411625943 907.2832725420959 964.4267603275954 359.99664304405735 0.011749449447124647 862.4202240520881 970.7299016306779 359.9980358605346 0.01182201389964371 908.0646563701695 979.5856333752163 359.9966598775792 0.01221644229242719 898.0908473101824 1024.5763199653786 359.99708683563597 0.013569367165536845 1065.204616724153 1024.0860229913724 359.99196049740675 0.014004081638146777 885.7802289652379 1035.3565019053842 359.9974933883064 0.013866840683593722 844.633490765497 1037.1253556255858 359.9987600304991 0.013810349979044616 983.3376890371602 1053.1813752305072 359.99454948334073 0.014676046032126217 716.705035791758 1093.54361922369 0.0028351580290036558 0.0151962842623869 546.9564287152346 1106.9809502324074 0.008077145440700317 0.0151515360313974
Difference each set of RA and Dec coordinates in both the input list and the found coordinates, taking into account any angles close to 360/0 degrees. If the difference for both the RA and Dec are below a set tolerance, then the positions match. Take the matched positions and convert the differences from degrees to milli arcseconds, and output the RA and Dec positions as well as the differences.
# Compare input RA, Dec to found RA, Dec
print(' RA found Dec found RA_Diff (mas) Dec_diff (mas) Bkg sub flux pass/fail')
deltara = []
deltadec = []
for i in np.arange(0,len(RA_sim)):
for j in np.arange(0,len(ra)):
ra_diff = 180 - abs(abs(RA_sim[i] - ra[j])-180)
dec_diff = 180 - abs(abs(Dec_sim[i] - dec[j])-180)
if ra_diff < 1e-5 and dec_diff < 1e-5:
# put differences in milliarcseconds
ra_diff = ra_diff * 3600000
dec_diff = dec_diff * 3600000
deltara.append(ra_diff)
deltadec.append(dec_diff)
if ra_diff < 30 and dec_diff < 30:
test = 'pass'
else:
test = 'fail'
print('{:15.6f} {:15.6f} {:15.6f} {:15.6f} {:15.5e} {}'.format(ra[j], dec[j], ra_diff, dec_diff,
phot_table['scaled_ap_sum_bkgsub'][j], test))
RA found Dec found RA_Diff (mas) Dec_diff (mas) Bkg sub flux pass/fail
359.998760 0.013810 21.490203 26.459925 1.04122e-08 pass
0.000281 -0.000993 21.570461 10.000211 1.02559e-08 pass
0.006618 -0.012201 24.635237 19.599177 1.02796e-08 pass
359.998520 -0.014307 9.818416 15.618735 1.02179e-08 pass
359.998145 -0.007168 17.373535 15.963561 1.01523e-08 pass
0.007351 -0.002369 22.256688 4.948993 1.02306e-08 pass
359.997473 0.003672 24.252507 15.199052 1.03423e-08 pass
0.008514 -0.001327 16.646003 8.076783 1.01656e-08 pass
0.001089 0.007726 26.574335 17.752580 1.02737e-08 pass
359.996643 0.011749 21.441394 19.618010 1.02591e-08 pass
0.006966 0.009082 20.142817 12.176682 1.01820e-08 pass
359.994080 -0.007261 19.382265 12.744172 1.03680e-08 pass
0.004903 -0.011629 14.573685 23.147285 1.05250e-08 pass
0.008077 0.015152 4.123587 5.270287 1.02961e-08 pass
359.993673 -0.009096 19.095813 24.769200 1.00301e-08 pass
0.002835 0.015196 13.831096 33.423345 9.91316e-09 fail
359.998036 0.011822 14.902075 14.450039 1.04562e-08 pass
0.006063 -0.013220 18.039868 15.292905 1.04139e-08 pass
359.999102 -0.000576 19.434169 10.891820 1.01103e-08 pass
359.998969 -0.004993 22.407769 15.549464 1.03284e-08 pass
0.009280 -0.007419 28.057803 14.663714 1.02859e-08 pass
359.991285 0.003947 16.595677 2.134626 1.01047e-08 pass
359.994944 -0.010067 17.974295 16.242879 1.02290e-08 pass
359.997986 -0.012220 14.397250 20.198953 1.03626e-08 pass
0.007294 0.006227 21.398002 7.895650 1.03638e-08 pass
359.992183 0.008567 16.454890 4.592447 1.02779e-08 pass
0.004043 -0.004200 14.316581 12.073104 1.02873e-08 pass
0.005772 -0.009177 24.923035 12.775285 1.02553e-08 pass
359.991960 0.014004 16.209336 32.693897 1.04173e-08 fail
359.990369 -0.012668 16.394494 22.882637 1.02794e-08 pass
359.996175 0.004833 20.507673 2.381278 1.02853e-08 pass
359.998126 0.008289 19.749860 12.265957 1.01706e-08 pass
0.008285 -0.012767 20.951727 21.064655 1.05109e-08 pass
0.008008 -0.009709 19.425894 17.005766 1.01831e-08 pass
359.993712 0.003252 21.745150 11.759934 1.01950e-08 pass
0.000194 -0.000228 22.460138 12.870266 1.02271e-08 pass
359.994719 0.002873 23.259219 6.893625 1.03165e-08 pass
359.992426 -0.012991 23.176816 19.910376 1.02316e-08 pass
0.000874 -0.014622 12.889337 12.744432 1.01459e-08 pass
0.005621 -0.008707 18.611727 20.849148 1.02342e-08 pass
0.008347 -0.009939 20.682052 19.047936 1.03329e-08 pass
359.996660 0.012216 22.040715 12.392253 1.01598e-08 pass
0.003023 -0.010502 13.809712 22.130624 1.02617e-08 pass
359.991013 -0.008845 17.283352 11.043504 1.02776e-08 pass
359.998390 -0.008212 17.607645 20.680020 1.04144e-08 pass
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in millarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(deltadec,deltara)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
The output RA and Dec coordinates should match the input RA and Dec coordinates to within 1/10 of a PSF FWHM (~0.03 arcsec for F770W).
Output RA_Diff and Dec_diff above should be on order of 30 or fewer milliarcseconds.
Check to see if your surface brightness is roughly what you expected based on the input data.
Another test that can be done is to plot the flux values against x and y values to check for any systmatic patterns. Previous testing has shown a spatial dependence of the flux with y values, such that there is a rise in surface brightness in the middle, and a drop at the image edges. A quick plot can show whether this problem is fixed or not. Prior to the resample step, there is no pattern, after the step, a pattern is clear. Just do this as a last check. If the scatter is not random, there may be a problem that needs to be checked. (Of course, this only works if you give an equivalent if not equal input count level to each input star.) If there is not an obvious rise in the middle (around y centroid pos of 550-600), then this test passes.
plt.title('Flux (MJy) vs. y position on detector')
plt.ylim(1.05e-08,1.12e-08)
plt.xlabel('y centroid position')
plt.ylabel('Surface brightness')
plt.plot(sources['ycentroid'], phot_table['scaled_ap_sum_bkgsub'], marker='o',linestyle='')
plt.show()
plt.title('Flux (MJy) vs. x position on detector')
plt.ylim(1.05e-08,1.12e-08)
plt.xlabel('x centroid position')
plt.ylabel('Surface brightness')
plt.plot(sources['xcentroid'], phot_table['scaled_ap_sum_bkgsub'], marker='o',linestyle='') #ylim=(30000,40000))
plt.show()
Check previous tests with different scaling factor to see if the RA/Dec values still line up and the photometry gives consistent results.
# Grab all *.cal files and create a new association table.
callist = glob.glob('starfield*cal.fits')
# use asn_from_list to create association table
asn = asn_from_list.asn_from_list(callist, rule=DMS_Level3_Base, product_name='starfield_50star4ptdither_scaled_combined.fits')
# use this if you need to add non'science' exposure types
#asn['products'][0]['members'][1]['exptype'] = 'background'
#asn['products'][0]['members'][2]['exptype'] = 'sourcecat'
# dump association table to a .json file for use in image3
with open('starfield_50star4ptdither_scaled_asnfile.json', 'w') as fp:
fp.write(asn.dump()[1])
# Run Calwebb_image3 on the association table
# set any specific parameters
# tweakreg parameters to allow data to run
fwhm = 5.0 # Gaussian kernel FWHM of objects expected, default=2.5
minobj = 5 # minimum number of objects needed to match positions for a good fit, default=15
snr = 50 # signal to noise threshold, default=5
sigma = 3 # clipping limit, in sigma units, used when performing fit, default=3
fit_geom = 'shift' # ftype of affine transformation to be considered when fitting catalogs, default='general'
use2dhist = False # boolean indicating whether to use 2D histogram to find initial offset, default=True
ratio = 0.5 # Ratio of input to output pixel scale. A value of 0.5 means the output image would have 4 pixels
# sampling each input pixel.
pipe3=Image3Pipeline()
pipe3.tweakreg.kernel_fwhm = fwhm
pipe3.tweakreg.snr_threshold = snr
pipe3.tweakreg.minobj = minobj
pipe3.tweakreg.sigma = sigma
pipe3.tweakreg.fitgeometry = fit_geom
#pipe3.tweakreg.skip = True
pipe3.tweakreg.use2dhist = use2dhist
pipe3.resample.pixel_scale_ratio = ratio
pipe3.source_catalog.save_results = True
pipe3.save_results = True
# run Image3
image = pipe3.run('starfield_50star4ptdither_scaled_asnfile.json')
print('Image 3 pipeline finished.')
2022-10-06 05:35:31,708 - stpipe.Image3Pipeline - INFO - Image3Pipeline instance created.
2022-10-06 05:35:31,709 - stpipe.Image3Pipeline.assign_mtwcs - INFO - AssignMTWcsStep instance created.
2022-10-06 05:35:31,711 - stpipe.Image3Pipeline.tweakreg - INFO - TweakRegStep instance created.
2022-10-06 05:35:31,712 - stpipe.Image3Pipeline.skymatch - INFO - SkyMatchStep instance created.
2022-10-06 05:35:31,714 - stpipe.Image3Pipeline.outlier_detection - INFO - OutlierDetectionStep instance created.
2022-10-06 05:35:31,715 - stpipe.Image3Pipeline.resample - INFO - ResampleStep instance created.
2022-10-06 05:35:31,716 - stpipe.Image3Pipeline.source_catalog - INFO - SourceCatalogStep instance created.
2022-10-06 05:35:31,947 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline running with args ('starfield_50star4ptdither_scaled_asnfile.json',).
2022-10-06 05:35:31,953 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'steps': {'assign_mtwcs': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'assign_mtwcs', 'search_output_file': True, 'input_dir': ''}, 'tweakreg': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': False, 'catalog_format': 'ecsv', 'kernel_fwhm': 5.0, 'snr_threshold': 50, 'sharplo': 0.2, 'sharphi': 1.0, 'roundlo': -1.0, 'roundhi': 1.0, 'brightest': 200, 'peakmax': None, 'bkg_boxsize': 400, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 2.0, 'use2dhist': False, 'separation': 1.0, 'tolerance': 0.7, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'shift', 'nclip': 3, 'sigma': 3, 'abs_refcat': '', 'save_abs_catalog': False, 'abs_minobj': 15, 'abs_searchrad': 6.0, 'abs_use2dhist': True, 'abs_separation': 0.1, 'abs_tolerance': 0.7, 'abs_fitgeometry': 'rshift', 'abs_nclip': 3, 'abs_sigma': 3.0}, 'skymatch': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '~DO_NOT_USE+NON_SCIENCE', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}, 'outlier_detection': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None, 'in_memory': False}, 'resample': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 0.5, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}, 'source_catalog': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 1000, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 25, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}}}
2022-10-06 05:35:32,076 - stpipe.Image3Pipeline - INFO - Prefetching reference files for dataset: 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits' reftypes = ['abvegaoffset', 'apcorr', 'drizpars']
2022-10-06 05:35:32,079 - stpipe.Image3Pipeline - INFO - Prefetch for ABVEGAOFFSET reference file is '/grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf'.
2022-10-06 05:35:32,080 - stpipe.Image3Pipeline - INFO - Prefetch for APCORR reference file is '/grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits'.
2022-10-06 05:35:32,081 - stpipe.Image3Pipeline - INFO - Prefetch for DRIZPARS reference file is '/grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits'.
2022-10-06 05:35:32,082 - stpipe.Image3Pipeline - INFO - Starting calwebb_image3 ...
2022-10-06 05:35:33,140 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg running with args (<ModelContainer>,).
2022-10-06 05:35:33,142 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': True, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_catalogs': False, 'catalog_format': 'ecsv', 'kernel_fwhm': 5.0, 'snr_threshold': 50, 'sharplo': 0.2, 'sharphi': 1.0, 'roundlo': -1.0, 'roundhi': 1.0, 'brightest': 200, 'peakmax': None, 'bkg_boxsize': 400, 'enforce_user_order': False, 'expand_refcat': False, 'minobj': 5, 'searchrad': 2.0, 'use2dhist': False, 'separation': 1.0, 'tolerance': 0.7, 'xoffset': 0.0, 'yoffset': 0.0, 'fitgeometry': 'shift', 'nclip': 3, 'sigma': 3, 'abs_refcat': '', 'save_abs_catalog': False, 'abs_minobj': 15, 'abs_searchrad': 6.0, 'abs_use2dhist': True, 'abs_separation': 0.1, 'abs_tolerance': 0.7, 'abs_fitgeometry': 'rshift', 'abs_nclip': 3, 'abs_sigma': 3.0}
2022-10-06 05:35:33,310 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits.
2022-10-06 05:35:33,486 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits.
2022-10-06 05:35:33,666 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits.
2022-10-06 05:35:33,850 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits.
2022-10-06 05:35:34,029 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits.
2022-10-06 05:35:34,208 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits.
2022-10-06 05:35:34,394 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits.
2022-10-06 05:35:34,577 - stpipe.Image3Pipeline.tweakreg - INFO - Detected 200 sources in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits.
2022-10-06 05:35:34,599 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:34,599 - stpipe.Image3Pipeline.tweakreg - INFO - Number of image groups to be aligned: 8.
2022-10-06 05:35:34,600 - stpipe.Image3Pipeline.tweakreg - INFO - Image groups:
2022-10-06 05:35:34,623 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal':
2022-10-06 05:35:34,623 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal
2022-10-06 05:35:34,648 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal':
2022-10-06 05:35:34,648 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal
2022-10-06 05:35:34,671 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal':
2022-10-06 05:35:34,672 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal
2022-10-06 05:35:34,696 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal':
2022-10-06 05:35:34,697 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal
2022-10-06 05:35:34,719 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal':
2022-10-06 05:35:34,720 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal
2022-10-06 05:35:34,744 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal':
2022-10-06 05:35:34,745 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal
2022-10-06 05:35:34,767 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal':
2022-10-06 05:35:34,768 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal
2022-10-06 05:35:34,792 - stpipe.Image3Pipeline.tweakreg - INFO - * Images in GROUP 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal':
2022-10-06 05:35:34,793 - stpipe.Image3Pipeline.tweakreg - INFO - starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal
2022-10-06 05:35:34,793 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:34,793 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:34,794 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() started on 2022-10-06 05:35:34.793926
2022-10-06 05:35:34,794 - stpipe.Image3Pipeline.tweakreg - INFO - Version 0.8.0
2022-10-06 05:35:34,794 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:35,028 - stpipe.Image3Pipeline.tweakreg - INFO - Selected image 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' as reference image
2022-10-06 05:35:35,034 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-10-06 05:35:35,154 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:35:35,156 - stpipe.Image3Pipeline.tweakreg - INFO - Found 73 matches for 'GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal'...
2022-10-06 05:35:35,157 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:35:35,159 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal:
2022-10-06 05:35:35,159 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -1.04064e-05 YSH: -9.45202e-06
2022-10-06 05:35:35,160 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:35,160 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.001818 FIT MAE: 0.00145054
2022-10-06 05:35:35,160 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 72 objects.
2022-10-06 05:35:35,198 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-10-06 05:35:35,324 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:35:35,325 - stpipe.Image3Pipeline.tweakreg - INFO - Found 53 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal'...
2022-10-06 05:35:35,326 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:35:35,328 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal:
2022-10-06 05:35:35,328 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0416528 YSH: -0.0266671
2022-10-06 05:35:35,328 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:35,329 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.316475 FIT MAE: 0.218744
2022-10-06 05:35:35,329 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 53 objects.
2022-10-06 05:35:35,366 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-10-06 05:35:35,493 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:35:35,495 - stpipe.Image3Pipeline.tweakreg - INFO - Found 55 matches for 'GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal'...
2022-10-06 05:35:35,495 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:35:35,497 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal:
2022-10-06 05:35:35,497 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.050707 YSH: -0.00657054
2022-10-06 05:35:35,498 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:35,498 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.317766 FIT MAE: 0.222451
2022-10-06 05:35:35,498 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 55 objects.
2022-10-06 05:35:35,533 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-10-06 05:35:35,653 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:35:35,655 - stpipe.Image3Pipeline.tweakreg - INFO - Found 60 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal'...
2022-10-06 05:35:35,655 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:35:35,657 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal:
2022-10-06 05:35:35,657 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.0119643 YSH: 0.0134823
2022-10-06 05:35:35,658 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:35,658 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.334214 FIT MAE: 0.223583
2022-10-06 05:35:35,658 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 60 objects.
2022-10-06 05:35:35,693 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-10-06 05:35:35,813 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:35:35,814 - stpipe.Image3Pipeline.tweakreg - INFO - Found 60 matches for 'GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal'...
2022-10-06 05:35:35,815 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:35:35,817 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal:
2022-10-06 05:35:35,817 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: -0.00110832 YSH: 0.0130964
2022-10-06 05:35:35,817 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:35,818 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.315695 FIT MAE: 0.201238
2022-10-06 05:35:35,818 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 60 objects.
2022-10-06 05:35:35,853 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' to the reference catalog.
2022-10-06 05:35:36,197 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:35:36,199 - stpipe.Image3Pipeline.tweakreg - INFO - Found 54 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal'...
2022-10-06 05:35:36,199 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:35:36,201 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal:
2022-10-06 05:35:36,201 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: 0.0142013 YSH: -0.00953756
2022-10-06 05:35:36,202 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:36,202 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.320146 FIT MAE: 0.220856
2022-10-06 05:35:36,202 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 54 objects.
2022-10-06 05:35:36,237 - stpipe.Image3Pipeline.tweakreg - INFO - Aligning image catalog 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' to the reference catalog.
2022-10-06 05:35:36,359 - stpipe.Image3Pipeline.tweakreg - INFO - Matching sources from 'starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal' catalog with sources from the reference 'starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal' catalog.
2022-10-06 05:35:36,361 - stpipe.Image3Pipeline.tweakreg - INFO - Found 53 matches for 'GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal'...
2022-10-06 05:35:36,361 - stpipe.Image3Pipeline.tweakreg - INFO - Performing 'shift' fit
2022-10-06 05:35:36,363 - stpipe.Image3Pipeline.tweakreg - INFO - Computed 'shift' fit for GROUP ID: starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal:
2022-10-06 05:35:36,363 - stpipe.Image3Pipeline.tweakreg - INFO - XSH: 0.00190551 YSH: -0.0279355
2022-10-06 05:35:36,364 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:36,364 - stpipe.Image3Pipeline.tweakreg - INFO - FIT RMSE: 0.30067 FIT MAE: 0.204943
2022-10-06 05:35:36,364 - stpipe.Image3Pipeline.tweakreg - INFO - Final solution based on 53 objects.
2022-10-06 05:35:36,400 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:36,400 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() ended on 2022-10-06 05:35:36.400028
2022-10-06 05:35:36,401 - stpipe.Image3Pipeline.tweakreg - INFO - ***** tweakwcs.imalign.align_wcs() TOTAL RUN TIME: 0:00:01.606102
2022-10-06 05:35:36,401 - stpipe.Image3Pipeline.tweakreg - INFO -
2022-10-06 05:35:36,556 - stpipe.Image3Pipeline.tweakreg - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:35:36,668 - stpipe.Image3Pipeline.tweakreg - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:35:36,679 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:35:36,679 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:35:36,886 - stpipe.Image3Pipeline.tweakreg - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/fitting.py:789: AstropyUserWarning: The fit may be poorly conditioned
warnings.warn("The fit may be poorly conditioned\n",
2022-10-06 05:35:36,897 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:35:36,897 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:35:37,009 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:35:37,009 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:35:37,116 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:35:37,117 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:35:37,221 - stpipe.Image3Pipeline.tweakreg - WARNING - Failed to update 'meta.wcsinfo' with FITS SIP approximation. Reported error is:
2022-10-06 05:35:37,222 - stpipe.Image3Pipeline.tweakreg - WARNING - "Failed to achieve required error tolerance"
2022-10-06 05:35:37,234 - stpipe.Image3Pipeline.tweakreg - INFO - Step tweakreg done
2022-10-06 05:35:37,485 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch running with args (<ModelContainer>,).
2022-10-06 05:35:37,487 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'skymethod': 'match', 'match_down': True, 'subtract': False, 'stepsize': None, 'skystat': 'mode', 'dqbits': '~DO_NOT_USE+NON_SCIENCE', 'lower': None, 'upper': None, 'nclip': 5, 'lsigma': 4.0, 'usigma': 4.0, 'binwidth': 0.1}
2022-10-06 05:35:37,709 - stpipe.Image3Pipeline.skymatch - INFO -
2022-10-06 05:35:37,710 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() started on 2022-10-06 05:35:37.709380
2022-10-06 05:35:37,710 - stpipe.Image3Pipeline.skymatch - INFO -
2022-10-06 05:35:37,710 - stpipe.Image3Pipeline.skymatch - INFO - Sky computation method: 'match'
2022-10-06 05:35:37,711 - stpipe.Image3Pipeline.skymatch - INFO - Sky matching direction: DOWN
2022-10-06 05:35:37,711 - stpipe.Image3Pipeline.skymatch - INFO - Sky subtraction from image data: OFF
2022-10-06 05:35:37,711 - stpipe.Image3Pipeline.skymatch - INFO -
2022-10-06 05:35:37,712 - stpipe.Image3Pipeline.skymatch - INFO - ---- Computing differences in sky values in overlapping regions.
2022-10-06 05:35:49,289 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0104564
2022-10-06 05:35:49,291 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.00699186
2022-10-06 05:35:49,291 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0247774
2022-10-06 05:35:49,292 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0148887
2022-10-06 05:35:49,292 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.0142996
2022-10-06 05:35:49,292 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0.0177906
2022-10-06 05:35:49,293 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_cal.fits. Sky background: 0.00264731
2022-10-06 05:35:49,294 - stpipe.Image3Pipeline.skymatch - INFO - * Image ID=starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_cal.fits. Sky background: 0
2022-10-06 05:35:49,294 - stpipe.Image3Pipeline.skymatch - INFO -
2022-10-06 05:35:49,294 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() ended on 2022-10-06 05:35:49.294397
2022-10-06 05:35:49,295 - stpipe.Image3Pipeline.skymatch - INFO - ***** jwst.skymatch.skymatch.match() TOTAL RUN TIME: 0:00:11.585017
2022-10-06 05:35:49,295 - stpipe.Image3Pipeline.skymatch - INFO -
2022-10-06 05:35:49,328 - stpipe.Image3Pipeline.skymatch - INFO - Step skymatch done
2022-10-06 05:35:49,545 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection running with args (<ModelContainer>,).
2022-10-06 05:35:49,547 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'crf', 'search_output_file': False, 'input_dir': '', 'weight_type': 'ivm', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'nlow': 0, 'nhigh': 0, 'maskpt': 0.7, 'grow': 1, 'snr': '5.0 4.0', 'scale': '1.2 0.7', 'backg': 0.0, 'save_intermediate_results': False, 'resample_data': True, 'good_bits': '~DO_NOT_USE', 'scale_detection': False, 'allowed_memory': None, 'in_memory': False}
2022-10-06 05:35:49,554 - stpipe.Image3Pipeline.outlier_detection - INFO - Performing outlier detection on 8 inputs
2022-10-06 05:35:49,554 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter kernel: square
2022-10-06 05:35:49,555 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:35:49,555 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter fillval: INDEF
2022-10-06 05:35:49,555 - stpipe.Image3Pipeline.outlier_detection - INFO - Driz parameter weight_type: ivm
2022-10-06 05:35:49,741 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:35:50,354 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:35:50,641 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-10-06 05:35:50,646 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:35:51,403 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:35:51,678 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-10-06 05:35:51,683 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:35:52,430 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:35:52,710 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-10-06 05:35:52,714 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:35:53,470 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:35:53,750 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-10-06 05:35:53,755 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:35:54,518 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:35:54,797 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-10-06 05:35:54,802 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:35:55,553 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:35:55,830 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-10-06 05:35:55,834 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:35:56,599 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:35:56,879 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_outlier_i2d.fits saved to file
2022-10-06 05:35:56,884 - stpipe.Image3Pipeline.outlier_detection - INFO - 1 exposures to drizzle together
2022-10-06 05:35:57,630 - stpipe.Image3Pipeline.outlier_detection - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:35:57,910 - stpipe.Image3Pipeline.outlier_detection - INFO - Exposure starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_outlier_i2d.fits saved to file
2022-10-06 05:36:04,099 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting median...
2022-10-06 05:36:04,191 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:36:04,774 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-10-06 05:36:05,065 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:36:05,787 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-10-06 05:36:06,111 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:36:06,842 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-10-06 05:36:07,165 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:36:07,899 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-10-06 05:36:08,217 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:36:08,946 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-10-06 05:36:09,264 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:36:10,005 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-10-06 05:36:10,325 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:36:11,096 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-10-06 05:36:11,701 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:335: RuntimeWarning: invalid value encountered in multiply
blotted_median.err *= 0.0 # None
2022-10-06 05:36:12,455 - stpipe.Image3Pipeline.outlier_detection - INFO - Blotting (1024, 1032) <-- (1142, 1119)
2022-10-06 05:36:12,669 - stpipe.Image3Pipeline.outlier_detection - INFO - Flagging outliers
2022-10-06 05:36:12,840 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:36:12,859 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:36:12,874 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 564 (0.05%)
2022-10-06 05:36:13,070 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:36:13,089 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:36:13,103 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 571 (0.05%)
2022-10-06 05:36:13,295 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:36:13,314 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:36:13,327 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 805 (0.08%)
2022-10-06 05:36:13,528 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:36:13,546 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:36:13,560 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 933 (0.09%)
2022-10-06 05:36:13,751 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:36:13,776 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:36:13,791 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 439 (0.04%)
2022-10-06 05:36:13,984 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:36:14,002 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:36:14,016 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 404 (0.04%)
2022-10-06 05:36:14,434 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:36:14,453 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:36:14,466 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 528 (0.05%)
2022-10-06 05:36:14,659 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:440: RuntimeWarning: overflow encountered in multiply
threshold1 = scale1 * blot_deriv + snr1 * err_data
2022-10-06 05:36:14,677 - stpipe.Image3Pipeline.outlier_detection - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/outlier_detection/outlier_detection.py:449: RuntimeWarning: overflow encountered in multiply
threshold2 = scale2 * blot_deriv + snr2 * err_data
2022-10-06 05:36:14,690 - stpipe.Image3Pipeline.outlier_detection - INFO - New pixels flagged as outliers: 494 (0.05%)
2022-10-06 05:36:14,953 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-10-06 05:36:15,230 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq1_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-10-06 05:36:15,505 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-10-06 05:36:15,787 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq2_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-10-06 05:36:16,062 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-10-06 05:36:16,337 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq3_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-10-06 05:36:16,609 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp1_a3001_crf.fits
2022-10-06 05:36:16,884 - stpipe.Image3Pipeline.outlier_detection - INFO - Saved model in starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_a3001_crf.fits
2022-10-06 05:36:16,884 - stpipe.Image3Pipeline.outlier_detection - INFO - Step outlier_detection done
2022-10-06 05:36:17,083 - stpipe.Image3Pipeline - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:419: ResourceWarning: unclosed file <_io.BufferedReader name='starfield_50star4ptdither_scaled_asnfile_starfield_50star4ptdither_seq4_MIRIMAGE_F1130Wexp2_a3001_blot.fits'>
gc.collect()
2022-10-06 05:36:17,095 - stpipe.Image3Pipeline.resample - INFO - Step resample running with args (<ModelContainer>,).
2022-10-06 05:36:17,097 - stpipe.Image3Pipeline.resample - INFO - Step resample parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'i2d', 'search_output_file': True, 'input_dir': '', 'pixfrac': 1.0, 'kernel': 'square', 'fillval': 'INDEF', 'weight_type': 'ivm', 'output_shape': None, 'crpix': None, 'crval': None, 'rotation': None, 'pixel_scale_ratio': 0.5, 'pixel_scale': None, 'single': False, 'blendheaders': True, 'allowed_memory': None, 'in_memory': True}
2022-10-06 05:36:17,118 - stpipe.Image3Pipeline.resample - INFO - Drizpars reference file: /grp/crds/cache/references/jwst/jwst_miri_drizpars_0001.fits
2022-10-06 05:36:17,142 - stpipe.Image3Pipeline.resample - INFO - Driz parameter kernel: square
2022-10-06 05:36:17,142 - stpipe.Image3Pipeline.resample - INFO - Driz parameter pixfrac: 1.0
2022-10-06 05:36:17,142 - stpipe.Image3Pipeline.resample - INFO - Driz parameter fillval: INDEF
2022-10-06 05:36:17,143 - stpipe.Image3Pipeline.resample - INFO - Driz parameter weight_type: ivm
2022-10-06 05:36:17,313 - stpipe.Image3Pipeline.resample - INFO - Blending metadata for starfield_50star4ptdither_scaled_combined.fits
2022-10-06 05:36:17,944 - stpipe.Image3Pipeline.resample - INFO - Resampling science data
2022-10-06 05:36:18,507 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:19,395 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:20,289 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:21,180 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:22,075 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:22,962 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:23,847 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:24,739 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:24,915 - stpipe.Image3Pipeline.resample - INFO - Resampling var_rnoise
2022-10-06 05:36:25,466 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:26,411 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:27,353 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:28,275 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:29,190 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:30,100 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:31,024 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:31,951 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:32,140 - stpipe.Image3Pipeline.resample - INFO - Resampling var_poisson
2022-10-06 05:36:32,705 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:33,628 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:34,549 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:35,460 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:36,371 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:37,276 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:38,175 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:39,112 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:39,300 - stpipe.Image3Pipeline.resample - INFO - Resampling var_flat
2022-10-06 05:36:39,854 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:40,768 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:41,674 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:42,578 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:43,489 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:44,392 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:45,293 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:46,195 - stpipe.Image3Pipeline.resample - INFO - Drizzling (1024, 1032) --> (1142, 1119)
2022-10-06 05:36:46,381 - stpipe.Image3Pipeline.resample - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/resample/resample.py:308: RuntimeWarning: divide by zero encountered in reciprocal
output_variance = np.reciprocal(inverse_variance_sum)
2022-10-06 05:36:46,422 - stpipe.Image3Pipeline.resample - INFO - Update S_REGION to POLYGON ICRS 0.021885075 -0.020259823 0.024958525 0.014762852 359.990641209 0.017774402 359.987567759 -0.017248273
2022-10-06 05:36:46,874 - stpipe.Image3Pipeline.resample - INFO - Saved model in starfield_50star4ptdither_scaled_combined_i2d.fits
2022-10-06 05:36:46,874 - stpipe.Image3Pipeline.resample - INFO - Step resample done
2022-10-06 05:36:47,132 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog running with args (<ImageModel(1142, 1119) from starfield_50star4ptdither_scaled_combined_i2d.fits>,).
2022-10-06 05:36:47,134 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': True, 'skip': False, 'suffix': 'cat', 'search_output_file': True, 'input_dir': '', 'bkg_boxsize': 1000, 'kernel_fwhm': 2.0, 'snr_threshold': 3.0, 'npixels': 25, 'deblend': False, 'aperture_ee1': 30, 'aperture_ee2': 50, 'aperture_ee3': 70, 'ci1_star_threshold': 2.0, 'ci2_star_threshold': 1.8}
2022-10-06 05:36:47,152 - stpipe.Image3Pipeline.source_catalog - INFO - Using APCORR reference file: /grp/crds/cache/references/jwst/jwst_miri_apcorr_0005.fits
2022-10-06 05:36:47,162 - stpipe.Image3Pipeline.source_catalog - INFO - Using ABVEGAOFFSET reference file: /grp/crds/cache/references/jwst/jwst_miri_abvegaoffset_0001.asdf
2022-10-06 05:36:47,163 - stpipe.Image3Pipeline.source_catalog - INFO - Instrument: MIRI
2022-10-06 05:36:47,163 - stpipe.Image3Pipeline.source_catalog - INFO - Detector: MIRIMAGE
2022-10-06 05:36:47,163 - stpipe.Image3Pipeline.source_catalog - INFO - Filter: F1130W
2022-10-06 05:36:47,164 - stpipe.Image3Pipeline.source_catalog - INFO - Subarray: FULL
2022-10-06 05:36:47,217 - stpipe.Image3Pipeline.source_catalog - INFO - AB to Vega magnitude offset 5.49349
2022-10-06 05:36:47,295 - stpipe.Image3Pipeline.source_catalog - INFO - Background could not be estimated in meshes. Using the entire unmasked array for background estimation: bkg_boxsize=(1142, 1119).
2022-10-06 05:36:47,521 - stpipe.Image3Pipeline.source_catalog - INFO - Detected 278 sources
2022-10-06 05:36:47,902 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote source catalog: starfield_50star4ptdither_scaled_combined_cat.ecsv
2022-10-06 05:36:48,028 - stpipe.Image3Pipeline.source_catalog - INFO - Saved model in starfield_50star4ptdither_scaled_combined_segm.fits
2022-10-06 05:36:48,030 - stpipe.Image3Pipeline.source_catalog - INFO - Wrote segmentation map: starfield_50star4ptdither_scaled_combined_segm.fits
2022-10-06 05:36:48,030 - stpipe.Image3Pipeline.source_catalog - INFO - Step source_catalog done
2022-10-06 05:36:48,032 - stpipe.Image3Pipeline - INFO - Step Image3Pipeline done
Image 3 pipeline finished.
# Read in the combined data file and list of coordinates
im2 = ImageModel('starfield_50star4ptdither_scaled_combined_i2d.fits')
#get pixel scale
pixarea2 = im2.meta.photometry.pixelarea_steradians
print('Pixel area in steradians', pixarea2)
print('Ratio of pixel area scales: original/new scale', pixarea / pixarea2)
# read in text file with RA and Dec input coordinates
RA_in, Dec_in = np.loadtxt( coords, dtype=str, unpack=True)
# put RA and Dec into floats
RA_sim = RA_in.astype(float)
Dec_sim = Dec_in.astype(float)
# pull out data portion of input file
data2 = im2.data
# print stats on input image
mean, median, std = sigma_clipped_stats(data2, sigma=200.0, maxiters=5) # default sigma=3
print('Image mean, median and std',mean, median, std)
Pixel area in steradians 7.1100902380771e-14 Ratio of pixel area scales: original/new scale 4.0 Image mean, median and std 10.159399 10.824437 46.724823
# Run DAOStarFinder to find sources in image
pixel_ratio = math.sqrt(pixarea / pixarea2) # ratio of pixel area scales in single dimension (sqrt of area)
ap_radius2 = ap_radius * pixel_ratio # radius for aperture for centroiding and photometry
print('New aperture radius', ap_radius2)
daofind = DAOStarFinder(fwhm=3.0*pixel_ratio, threshold=10.*std) # default threshold=5*std, fwhm=3
sources2 = daofind(data2)
#print(sources2['xcentroid','ycentroid','peak'])
sources2.pprint_all()
# Create apertures for x,y positions
positions2 = tuple(zip(sources2['xcentroid'], sources2['ycentroid']))
#print(positions)
#positions = (sources['xcentroid'], sources['ycentroid'])
apertures2 = CircularAperture(positions2, r=ap_radius2)
New aperture radius 10.0 id xcentroid ycentroid sharpness roundness1 roundness2 npix sky peak flux mag --- ------------------ ------------------ ------------------ ------------ --------------------- ---- --- ----------------- ------------------ ------------------- 1 695.8148913545083 122.66066510850565 0.5583964985271366 0.059600648 0.04211940686311831 49 0.0 2710.330322265625 9.637730598449707 -2.4599369559707855 2 772.8912378334629 126.06100015700252 0.5603930692106679 0.020375542 0.0532789656908137 49 0.0 2806.707275390625 10.00119686126709 -2.5001299397851358 3 973.7718874406253 151.3128757392191 0.5312807936151035 -0.02924974 0.046551988849745915 49 0.0 2616.81298828125 9.65421199798584 -2.4617920782785014 4 1041.3209618605656 155.904950275729 0.5849902854765686 -0.015508978 0.00574869523271661 49 0.0 2843.92138671875 9.81488037109375 -2.4797125263987785 5 531.9013491162301 182.7283392411226 0.5658126203372418 0.045580488 0.04283175175854685 49 0.0 2796.250244140625 9.892815589904785 -2.488299783879916 6 796.0540974759986 192.118463451694 0.5595924245324788 0.028545221 0.04732278749828406 49 0.0 2850.677734375 10.199710845947266 -2.521469650044616 7 461.2188136154165 203.64188724843325 0.544821620106931 -0.022865513 0.0653600208754654 49 0.0 2740.05908203125 9.916425704956055 -2.490887906106963 8 516.7643604116995 217.23363101359183 0.567568438774772 -0.01860665 0.02470882542413355 49 0.0 2715.14453125 9.537980079650879 -2.4486410276553108 9 573.9474940640577 230.854399521725 0.5632875007888266 0.03711726 0.036175696249214656 49 0.0 2834.9052734375 10.08846378326416 -2.5095625981380247 10 900.6027137646884 253.14962709013565 0.5587013361882072 -0.044757325 -0.011461137920011463 49 0.0 2736.788330078125 9.726634979248047 -2.4699065449902102 11 637.9579164691199 262.0154987165952 0.5681153379507041 0.03338333 0.048972975458293176 49 0.0 2827.500244140625 9.987557411193848 -2.498648221929782 12 944.4684375136576 280.9161849201773 0.5530986336662546 -0.051399566 -0.04205124342466878 49 0.0 2682.143310546875 9.561372756958008 -2.4513006245113838 13 1031.3171718662836 281.5914247254977 0.5664181809407389 -0.06512116 0.0528652187112787 49 0.0 2690.93798828125 9.411223411560059 -2.4341152079713346 14 467.2244460409289 295.3062743689553 0.5482216985686768 0.0816859 0.05394513146809236 49 0.0 2734.33740234375 9.839690208435059 -2.4824535634347806 15 478.9188179051204 301.8220631771948 0.5447463305671 0.02179219 0.03283468304114019 49 0.0 2772.13134765625 10.121659278869629 -2.513129284368955 16 552.7301036912696 312.75079153527406 0.5686388295085602 0.078030504 0.01137650380467449 49 0.0 2828.820556640625 9.95322322845459 -2.494909361072451 17 794.3307792835743 322.90056366617745 0.5608095178224761 -0.004055232 0.012849301428136128 49 0.0 2764.97119140625 9.794397354125977 -2.477444297909733 18 559.006736923035 327.41385897412425 0.5246472411851385 0.059039768 0.09821661029232993 49 0.0 2725.79443359375 10.161917686462402 -2.5174391817939017 19 936.5400018865063 341.5221551723926 0.5803220789153536 0.17337292 0.022542454739232987 49 0.0 2679.354736328125 9.107954025268555 -2.3985520743399307 20 805.2261709189493 356.0550935758804 0.5677098543038218 0.035775185 0.031357477771854936 49 0.0 2836.228271484375 10.02447509765625 -2.502654103315435 21 444.1841691528409 379.4746580576137 0.5649301129860412 0.122257896 0.09788110948707869 49 0.0 2709.16259765625 9.503252983093262 -2.4446807265867165 22 728.9538616020852 405.0999256064648 0.5663839252665087 -0.006561974 -0.13870387713543708 49 0.0 5185.5029296875 18.46764373779297 -3.166028719792652 23 784.77191711594 428.7447413846582 0.5738368665709336 0.08141041 0.03882949269066826 49 0.0 2870.177001953125 10.057256698608398 -2.5061988377018594 24 622.897669254673 468.82837148918304 0.5545689355665105 0.034724604 0.028704212443266222 49 0.0 2776.196044921875 10.020678520202637 -2.5022428236891043 25 520.9797559940921 537.5099855060396 0.5411245945429943 0.06303756 0.11191003083147764 49 0.0 2710.676513671875 9.849453926086426 -2.4835303824720785 26 753.6770952513481 561.9140347930932 0.5679412514617929 0.037877385 0.006717000960014323 49 0.0 2758.9384765625 9.72217845916748 -2.469408971675652 27 793.0480619090123 572.0380646796729 0.5520745457858885 0.016769849 0.02017986527176119 49 0.0 2823.855712890625 10.278944969177246 -2.5298713524121808 28 486.3204665419441 574.5087328801661 0.5324838923228061 0.16034295 0.08197811758278203 49 0.0 2552.061767578125 9.312530517578125 -2.4226692724027026 29 758.6932153383941 586.3623840481952 0.541806908689179 -0.056007635 0.05890351688868505 49 0.0 2650.643798828125 9.605571746826172 -2.4563080505584676 30 398.7884714951774 625.3163008979477 0.5664972786625588 -0.029657308 0.019160055590425423 49 0.0 2736.708251953125 9.64902114868164 -2.4612081457200494 31 944.650613664702 671.2040351809386 0.5677534625984966 -0.06445875 -0.00694224843582731 49 0.0 2700.7744140625 9.47908878326416 -2.441916477464236 32 978.2787006741135 680.6382384505871 0.5417807693710455 -0.055516917 0.06562115042147036 49 0.0 2707.519775390625 9.823206901550293 -2.480633228704754 33 1058.9022923654763 696.3046348134035 0.5788507090171706 0.0032079003 0.05757958686431536 49 0.0 2856.848876953125 9.940605163574219 -2.4935320603898687 34 857.7517390064626 704.8148063923122 0.5722036642916084 0.05961003 0.030555036177652525 49 0.0 2801.183349609375 9.813475608825684 -2.4795571184514515 35 903.0788625775233 738.8287831962632 0.5631225716670428 0.0016888735 0.03476654360212628 49 0.0 2793.6796875 9.974200248718262 -2.497195207891228 36 547.233308443433 815.5265269354649 0.5673747033486911 -0.043870293 0.047757219391493556 49 0.0 2710.924072265625 9.487589836120605 -2.4428897529299194 37 752.2730935614596 846.2743847826079 0.5687402567494032 0.0774154 0.04204700656772096 49 0.0 2694.54736328125 9.465775489807129 -2.4403904990373686 38 1042.9617808210196 848.3726792592023 0.5769081542922989 0.0011081266 0.04499338389475326 49 0.0 2826.05517578125 9.856125831604004 -2.4842655985622457 39 849.8322714542604 856.1580180553001 0.5692932623597524 -0.025590394 0.008525998837240846 49 0.0 2753.58740234375 9.722539901733398 -2.4694493354672504 40 565.9711504421033 906.934442155346 0.5679289450216788 0.021710578 0.027020909206395376 49 0.0 2913.079345703125 10.38723087310791 -2.5412494615740884 41 907.5613197547759 963.8882825644813 0.5677086306977029 0.011235579 -0.05416785756601128 49 0.0 2777.734375 9.759860038757324 -2.4736089742816856 42 862.7987792341199 970.2510393021502 0.5711448817639292 -0.034933746 0.026491109923556147 49 0.0 2876.698486328125 10.145177841186523 -2.515649161141254 43 908.3280568501616 979.112107637522 0.5690663327933708 0.008404639 -0.019735399117388554 49 0.0 2818.17333984375 9.92554759979248 -2.491886191108714 44 1065.6669666608627 1023.3566594309345 0.5471052477775425 -0.09873836 0.007449528057182105 49 0.0 2680.394287109375 9.658806800842285 -2.4623086980737865 45 898.3831908771696 1023.8539458471982 0.5509058520547878 -0.061362468 -0.02826610377540439 49 0.0 2817.801513671875 10.168439865112305 -2.518135811523022 46 886.0936225228785 1034.6602142424574 0.5570259499418851 0.0015755878 0.06536535009674144 49 0.0 2860.58349609375 10.243157386779785 -2.526084614328224 47 844.9871803780068 1036.4609522113055 0.5809757172852353 0.066408806 0.06679810611394578 49 0.0 2752.110107421875 9.492852210998535 -2.4434917990846077 48 983.7667091728193 1052.441625553932 0.5497241530368835 -0.06962309 0.045167551885122566 49 0.0 2741.9658203125 9.86079216003418 -2.484779512736527 49 717.1278342894451 1092.909260558465 0.5763866006370325 0.009492079 0.03269308467755625 49 0.0 2911.105712890625 10.246695518493652 -2.526459578243767 50 547.3719848483114 1106.7735348698204 0.5371207281512834 -0.082943566 -0.046585862696981416 49 0.0 2943.24658203125 10.894466400146484 -2.593014909505935
# mark sources on image frame to see if the correct sources were found
norm = ImageNormalize(stretch=SqrtStretch())
# keep image stretch in mind for plotting. sky subtracted range ~ (-15, 10), single sample ~ (0, 20)
plt.figure(figsize=(20,20))
plt.imshow(data2, cmap='Greys', origin='lower', vmin=8,vmax=15)#, norm=norm)
apertures2.plot(color='red', lw=2.5) #, alpha=0.5)
plt.show()
# set values for inner and outer annuli to collect background counts
inner_annulus2 = inner_annulus * pixel_ratio
outer_annulus2 = outer_annulus * pixel_ratio
# set up annulus for background
background_aper2 = CircularAnnulus(positions2, r_in=inner_annulus2, r_out=outer_annulus2)
# perform photometry on apertures for targets and background annuli
phot_table2 = aperture_photometry(im2.data, apertures2)
# perform background subtraction with outlier rejection
bkg_median = []
bkg_mask2 = background_aper2.to_mask(method='center')
bmask2 = bkg_mask2[0]
for mask in bkg_mask2:
aper_data = bmask2.multiply(data2)
aper_data = aper_data[mask.data > 0]
# perform sigma-clipped median
_, median_sigclip, _ = sigma_clipped_stats(aper_data)
bkg_median.append(median_sigclip)
bkg_median = np.array(bkg_median)
# do calculations on background regions found in annuli
# Get average background per pixel
phot_table2['annulus_median'] = bkg_median
# Get total background in the science aperture (per pixel * area in aperture)
phot_table2['aperture_bkg'] = bkg_median * apertures2.area
# subtract background in aperture from flux in aperture
phot_table2['aperture_sum_bkgsub'] = phot_table2['aperture_sum'] - phot_table2['aperture_bkg']
# put aperture sum in pixel scale
phot_table2['scaled_ap_sum_bkgsub'] = phot_table2['aperture_sum_bkgsub'] * pixarea2
phot_table2_sub = phot_table2['aperture_sum','annulus_median','aperture_bkg','aperture_sum_bkgsub','scaled_ap_sum_bkgsub']
phot_table2_sub.pprint_all()
aperture_sum annulus_median aperture_bkg aperture_sum_bkgsub scaled_ap_sum_bkgsub ------------------ ------------------ ------------------ ------------------- ---------------------- 47507.53381748896 11.294155597686768 3548.163625419279 43959.370192069684 3.125550888746521e-09 48189.15561808404 11.301733493804932 3550.544291696728 44638.61132638731 3.173845546330643e-09 47175.635595679836 11.301733493804932 3550.544291696728 43625.09130398311 3.101783358156725e-09 47229.582564642435 11.300782680511475 3550.245584890962 43679.336979751475 3.1056402746541104e-09 47662.87147774041 11.300673484802246 3550.2112800471705 44112.660197693236 3.136449946472309e-09 48372.84259743671 11.301979064941406 3550.6214401445563 44822.22115729216 3.1869003709939584e-09 48305.22905069726 11.3015718460083 3550.4935085436914 44754.73554215357 3.1821020828598833e-09 47112.369975534704 11.301733493804932 3550.544291696728 43561.825683837975 3.097285115474727e-09 47970.25451528575 11.299074172973633 3549.7088414180134 44420.54567386774 3.1583408816582497e-09 47719.696320587915 11.300891876220703 3550.2798897347534 44169.41643085316 3.1404853658657133e-09 47902.06017189331 11.300673484802246 3550.2112800471705 44351.84889184614 3.1534564784658587e-09 47582.5856304405 11.3001070022583 3550.033314307326 44032.55231613318 3.1307542038055774e-09 47316.8193077115 11.301231861114502 3550.3866991392224 43766.43260857228 3.11183285245669e-09 51325.860041669 11.302821159362793 3550.885991909342 47774.97404975966 3.396843766155829e-09 51004.590280626755 11.300673484802246 3550.2112800471705 47454.37900057958 3.374049168860318e-09 49200.97625488734 11.298582077026367 3549.554244916734 45651.42200997061 3.245857299874301e-09 48145.226050854195 11.300673484802246 3550.2112800471705 44595.01477080702 3.170745791888191e-09 49985.0848645239 11.304595947265625 3551.443557973064 46433.64130655084 3.3014737977208074e-09 47699.78014564965 11.299540519714355 3549.8553485674815 44149.924797082174 3.1390994931157206e-09 48172.44797706766 11.300891876220703 3550.2798897347534 44622.16808733291 3.1726764171958123e-09 47616.65350222755 11.30335521697998 3551.053771058017 44065.59973116953 3.1331039048360137e-09 86835.41419382997 11.301733493804932 3550.544291696728 83284.86990213324 5.9216294047067886e-09 48349.61437950687 11.298582077026367 3549.554244916734 44800.06013459014 3.1853247022821638e-09 47512.342085179815 11.300673484802246 3550.2112800471705 43962.13080513264 3.1257471708264216e-09 48364.44542212816 11.301979064941406 3550.6214401445563 44813.82398198361 3.186303324252071e-09 47537.58958338728 11.300673484802246 3550.2112800471705 43987.378303340105 3.1275422907318292e-09 47928.70324757218 11.301231861114502 3550.3866991392224 44378.31654843296 3.155338352733086e-09 47333.22090553363 11.301733493804932 3550.544291696728 43782.6766138369 3.1129878158892828e-09 48057.20480013195 11.301979064941406 3550.6214401445563 44506.583359987395 3.164458238780111e-09 47058.138894801596 11.301895141601562 3550.5950748497644 43507.54381995183 3.093425625969512e-09 46949.31311166733 11.301733493804932 3550.544291696728 43398.7688199706 3.0856916253143783e-09 48380.46070679005 11.301231861114502 3550.3866991392224 44830.07400765083 3.187458715740721e-09 47776.24253603948 11.301895141601562 3550.5950748497644 44225.647461189714 3.144483442864443e-09 47582.18820480573 11.3001070022583 3550.033314307326 44032.15489049841 3.1307259464843157e-09 47213.99097206963 11.300782680511475 3550.245584890962 43663.74538717867 3.104531698352631e-09 47311.99980651022 11.301979064941406 3550.6214401445563 43761.378366365665 3.111473491274949e-09 46583.468782498894 11.302821159362793 3550.885991909342 43032.58279058955 3.059655468186154e-09 47533.870017697824 11.303318500518799 3551.0422362415457 43982.827781456275 3.1272187445195855e-09 46721.40597022796 11.301979064941406 3550.6214401445563 43170.78453008341 3.069481736574759e-09 47858.85560855048 11.3001070022583 3550.033314307326 44308.82229424316 3.150397248549913e-09 49617.932540706504 11.299074172973633 3549.7088414180134 46068.223699288494 3.2754922760986325e-09 48238.35813462887 11.301937103271484 3550.6082574971606 44687.74987713171 3.177339341630253e-09 49644.85686366832 11.3015718460083 3550.4935085436914 46094.36335512463 3.2773508292165043e-09 47821.3853665246 11.301937103271484 3550.6082574971606 44270.77710902744 3.1476922015498314e-09 49928.717297551906 11.300891876220703 3550.2798897347534 46378.43740781715 3.2975487507059057e-09 50243.580082722685 11.301979064941406 3550.6214401445563 46692.95864257813 3.3199114943153253e-09 47219.120316827975 11.304595947265625 3551.443557973064 43667.67675885491 3.1048112224264055e-09 48346.006433355404 11.303205013275146 3551.0065831724523 44794.999850182954 3.1849649114945097e-09 48024.15406626534 11.299074172973633 3549.7088414180134 44474.44522484733 3.1621731883708173e-09 49966.88424595036 11.3001070022583 3550.033314307326 46416.85093164303 3.3002799869135503e-09
# using wcs info from images, put coordinates into RA, Dec
ra2, dec2 = im2.meta.wcs(sources2['xcentroid'], sources2['ycentroid'])
# add RA, Dec to sources table
ra_col = Column(name='RA', data=ra2)
dec_col = Column(name='Dec', data=dec2)
sources2.add_column(ra_col)
sources2.add_column(dec_col)
# print RA, Dec for each x, y position found
#print(sources2['xcentroid', 'ycentroid', 'RA', 'Dec'])
sources2_sub = sources2['xcentroid', 'ycentroid', 'RA', 'Dec']
sources2_sub.pprint_all()
# add option to print out list of sources with flux values
outtable = 'sourcelist_phot_rate.txt'
sources2.add_column(phot_table2['aperture_sum'])
sources2.add_column(phot_table2['aperture_sum_bkgsub'])
sources2.add_column(phot_table2['scaled_ap_sum_bkgsub'])
xcentroid ycentroid RA Dec ------------------ ------------------ ---------------------- ----------------------- 695.8148913545083 122.66066510850565 0.0008760484976707871 -0.014625448199400289 772.8912378334629 126.06100015700252 359.99852143445634 -0.01431373263947474 973.7718874406253 151.3128757392191 359.9924288183528 -0.012998684406977956 1041.3209618605656 155.904950275729 359.990369592624 -0.012676061343637603 531.9013491162301 182.7283392411226 0.006064582733750613 -0.01322444067942545 796.0540974759986 192.118463451694 359.9979888591047 -0.012225554880901636 461.2188136154165 203.64188724843325 0.00828854804522523 -0.012773294258763215 516.7643604116995 217.23363101359183 0.006621665180805069 -0.012206975810126251 573.9474940640577 230.854399521725 0.004904639172453884 -0.01163536000620962 900.6027137646884 253.14962709013565 359.9949468309532 -0.010072490366923415 637.9579164691199 262.0154987165952 0.003025441007653605 -0.010507445894009286 944.4684375136576 280.9161849201773 359.99367629162856 -0.009102894660693516 1031.3171718662836 281.5914247254977 359.99101464564023 -0.008848451554995728 467.2244460409289 295.3062743689553 0.008351063419579832 -0.009945982383140374 478.9188179051204 301.8220631771948 0.008009958109147754 -0.0097146842877947 552.7301036912696 312.75079153527406 0.005775737479443391 -0.009180876418933583 794.3307792835743 322.90056366617745 359.9983936817268 -0.008219387981768555 559.006736923035 327.41385897412425 0.005622709195446873 -0.008714299547286022 936.5400018865063 341.5221551723926 359.99408254770174 -0.007265578022505668 805.2261709189493 356.0550935758804 359.9981487719221 -0.007173287437524126 444.1841691528409 379.4746580576137 0.009284180301482222 -0.007426727594487946 728.9538616020852 405.0999256064648 0.0006198728659787429 -0.0058744589276117165 784.77191711594 428.7447413846582 359.9989716884746 -0.004999101002180068 622.897669254673 468.82837148918304 0.00404389911303126 -0.0042054725998300286 520.9797559940921 537.5099855060396 0.007354343672258665 -0.0023734459624602023 753.6770952513481 561.9140347930932 0.00028369638771039065 -0.000998771070327618 793.0480619090123 572.0380646796729 359.9991035204261 -0.000582330335891263 486.3204665419441 574.5087328801661 0.008516843586164608 -0.0013320522592393403 758.6932153383941 586.3623840481952 0.00019566032819691562 -0.00023549310469801017 398.7884714951774 625.3163008979477 0.011337998851565752 -9.467430577803988e-06 944.650613664702 671.2040351809386 359.9947210812974 0.0028668820433944598 978.2787006741135 680.6382384505871 359.99371517057995 0.0032467115251177824 1058.9022923654763 696.3046348134035 359.9912847817945 0.0039441472803893145 857.7517390064626 704.8148063923122 359.99747653853825 0.0036637821175658576 903.0788625775233 738.8287831962632 359.996177994816 0.004828905694235193 547.233308443433 815.5265269354649 0.0072974261287763265 0.00622337764669842 752.2730935614596 846.2743847826079 0.001092049409836314 0.007718168988193362 1042.9617808210196 848.3726792592023 359.99218290162287 0.00856484558927617 849.8322714542604 856.1580180553001 359.99812671954487 0.008283838387715629 565.9711504421033 906.934442155346 0.006968781853980727 0.00907709013610563 907.5613197547759 963.8882825644813 359.9966462272311 0.011743058512907498 862.7987792341199 970.2510393021502 359.998036121788 0.011817721737828194 908.3280568501616 979.112107637522 359.9966636847411 0.01221200387813538 1065.6669666608627 1023.3566594309345 359.9919575146852 0.013992332660091417 898.3831908771696 1023.8539458471982 359.99708908545347 0.01355737500281077 886.0936225228785 1034.6602142424574 359.9974950627722 0.013855705187720762 844.9871803780068 1036.4609522113055 359.9987605549815 0.013800300752439508 983.7667091728193 1052.441625553932 359.99454749482015 0.014663888834383965 717.1278342894451 1092.909260558465 0.002833643950035859 0.0151873424353598 547.3719848483114 1106.7735348698204 0.008077002496503463 0.015155668142605395
# Compare input RA, Dec to found RA, Dec
print(' RA found Dec found RA_Diff (mas) Dec_diff (mas) Bkg sub flux pass/fail')
deltara2 = []
deltadec2 = []
for i in np.arange(0,len(RA_sim)):
for j in np.arange(0,len(ra2)):
ra_diff = 180 - abs(abs(RA_sim[i] - ra2[j])-180)
dec_diff = 180 - abs(abs(Dec_sim[i] - dec2[j])-180)
if ra_diff < 1e-5 and dec_diff < 1e-5:
# put differences in milliarcseconds
ra_diff = ra_diff * 3600000
dec_diff = dec_diff * 3600000
deltara2.append(ra_diff)
deltadec2.append(dec_diff)
if ra_diff < 30 and dec_diff < 30:
test = 'pass'
else:
test = 'fail'
print('{:15.6f} {:15.6f} {:15.6f} {:15.6f} {:15.6e} {}'.format(ra2[j], dec2[j], ra_diff, dec_diff,
phot_table2['scaled_ap_sum_bkgsub'][j], test))
RA found Dec found RA_Diff (mas) Dec_diff (mas) Bkg sub flux pass/fail
359.998761 0.013800 19.602067 9.717291 3.104811e-09 pass
359.997495 0.013856 14.174020 1.061324 3.319911e-09 pass
0.000284 -0.000999 11.893004 9.975853 3.127542e-09 pass
0.006622 -0.012207 12.005349 3.512916 3.097285e-09 pass
359.998521 -0.014314 5.635957 9.837502 3.173846e-09 pass
359.998149 -0.007173 4.421080 4.634775 3.172676e-09 pass
0.007354 -0.002373 9.562780 12.405465 3.186303e-09 pass
359.997477 0.003664 12.461262 15.184377 3.130726e-09 pass
0.008517 -0.001332 7.763090 10.988133 3.112988e-09 pass
0.001092 0.007718 14.222125 10.191643 3.059655e-09 pass
359.996646 0.011743 9.981968 3.389354 3.275492e-09 pass
0.006969 0.009077 11.585326 6.875510 3.150397e-09 pass
359.994083 -0.007266 8.828274 2.080881 3.139099e-09 pass
0.004905 -0.011635 8.498979 1.296022 3.158341e-09 pass
0.008077 0.015156 3.608987 9.605313 3.300280e-09 pass
359.993676 -0.009103 6.150137 0.379221 3.130754e-09 pass
0.002834 0.015187 19.281780 1.232767 3.162173e-09 pass
359.998036 0.011818 13.961563 1.001744 3.177339e-09 pass
0.006065 -0.013224 12.302158 1.586446 3.136450e-09 pass
359.999104 -0.000582 12.526466 11.989209 3.155338e-09 pass
359.998972 -0.004999 11.921491 7.563608 3.185325e-09 pass
0.009284 -0.007427 13.750915 13.419340 3.133104e-09 pass
359.997089 0.013557 10.492368 5.849990 3.297549e-09 pass
359.991285 0.003944 18.785540 6.669791 3.144483e-09 pass
359.994947 -0.010072 7.808569 1.765321 3.140485e-09 pass
359.997989 -0.012226 4.107223 1.602429 3.186900e-09 pass
0.007297 0.006223 9.265936 5.840472 3.111473e-09 pass
359.992183 0.008565 18.354158 4.155879 3.127219e-09 pass
0.004044 -0.004205 11.163193 8.901359 3.125747e-09 pass
0.005776 -0.009181 11.745074 0.444892 3.245857e-09 pass
359.991958 0.013992 26.947133 9.602424 3.147692e-09 pass
359.990370 -0.012676 15.866553 7.420837 3.105640e-09 pass
359.994547 0.014664 23.418647 7.600196 3.184965e-09 pass
359.996178 0.004829 10.818662 11.139501 3.104532e-09 pass
359.998127 0.008284 15.409638 7.781804 3.069482e-09 pass
0.008289 -0.012773 8.827037 1.059332 3.182102e-09 pass
0.008010 -0.009715 10.950807 2.463436 3.374049e-09 pass
359.993715 0.003247 10.185912 8.238510 3.187459e-09 pass
0.000196 -0.000235 15.622818 12.575177 3.164458e-09 pass
359.994721 0.002867 14.107329 14.824644 3.085692e-09 pass
359.992429 -0.012999 11.453930 6.063865 3.101783e-09 pass
0.000876 -0.014625 7.025408 1.986482 3.125551e-09 pass
0.005623 -0.008714 11.846896 4.678370 3.301474e-09 pass
0.008351 -0.009946 6.971690 7.136579 3.396844e-09 pass
359.996664 0.012212 8.334932 3.586039 3.277351e-09 pass
0.003025 -0.010507 5.612372 1.994782 3.153456e-09 pass
359.991015 -0.008848 12.075695 1.625598 3.111833e-09 pass
359.998394 -0.008219 4.745784 4.996734 3.170746e-09 pass
# Plot ra and dec differences
plt.title ('Differences in RA and Dec in millarcseconds')
plt.ylabel('Delta RA')
plt.xlabel('Delta Dec')
plt.scatter(deltadec2,deltara2)
plt.show()
# Plot should show no differences greater than 30 milliarcseconds
# Compare photometry between the original and scaled images
plt.title('Flux (MJy) vs. y position on detector')
#plt.ylim(33500,39000) # help weed out sources that were erroneously 'hits' (bad pixels, cosmic rays, etc)
plt.ylim(1.05e-08,1.12e-08)
plt.xlabel('y centroid position')
plt.ylabel('Surface brightness')
plt.plot(sources['ycentroid'], phot_table['scaled_ap_sum_bkgsub'], marker='o',linestyle='')
plt.plot(sources2['ycentroid']/2, phot_table2['scaled_ap_sum_bkgsub'], marker='+',linestyle='')
plt.show()
# Compare photometry between the original and scaled images
plt.title('Flux (MJy) vs. x position on detector')
#plt.ylim(33500,39000) # help weed out sources that were erroneously 'hits' (bad pixels, cosmic rays, etc)
plt.ylim(1.05e-08,1.12e-08)
plt.xlabel('x centroid position')
plt.ylabel('Surface brightness')
plt.plot(sources['xcentroid'], phot_table['scaled_ap_sum_bkgsub'], marker='o',linestyle='')
plt.plot(sources2['xcentroid']/2, phot_table2['scaled_ap_sum_bkgsub'], marker='+',linestyle='')
plt.show()
# Get some statistics of the two sets of fluxes for comparison
# get stddev from mean for each of the measurements in percentage
photdata1 = phot_table['scaled_ap_sum_bkgsub']
photdata2 = phot_table2['scaled_ap_sum_bkgsub']
std1 = np.std(photdata1)
mean1 = np.mean(photdata1)
std2 = np.std(photdata2)
mean2 = np.mean(photdata2)
per1 = std1 / mean1 * 100
per2 = std2 / mean2 * 100
print('Mean and standard deviation of original scale data', mean1, std1)
print('Mean and standard deviation of new scale data', mean2, std2)
print('The standard deviation from the mean (as a percentage) for the original scale flux data, is', per1)
print('The standard deviation from the mean (as a percentage) for the new scaled flux data, is', per2)
# Compare stats on overall image values, not just phot values
# im is the original scaled image and im2 is the rescaled image
# print stats on original input image
mean1, median1, std1 = sigma_clipped_stats(data, sigma=200.0, maxiters=5) # default sigma=3
print('Original image mean, median and std',mean1, median1, std1)
# print stats on rescaled input image
mean2, median2, std2 = sigma_clipped_stats(data2, sigma=200.0, maxiters=5) # default sigma=3
print('Rescaled image mean, median and std',mean2, median2, std2)
ratio_mean = mean1 / mean2
#ratio_median = median1 / median2
print('The ratio of the mean of the two images is: ', ratio_mean)
#print('The ratio of the median of the two images is: ', ratio_median)
Mean and standard deviation of original scale data 1.0439144563964573e-08 1.1809115077171173e-09 Mean and standard deviation of new scale data 3.224594325046856e-09 3.925205294975616e-10 The standard deviation from the mean (as a percentage) for the original scale flux data, is 11.312339823260684 The standard deviation from the mean (as a percentage) for the new scaled flux data, is 12.17271042278653 Original image mean, median and std 10.161678 10.829916 46.34863 Rescaled image mean, median and std 10.159399 10.824437 46.724823 The ratio of the mean of the two images is: 1.0002244
If all RA/Dec matches have a 'pass' in the table for both original and scaled images, the fluxes for both the original data set and the scaled data set are roughly equal and the mean fluxes are nearly equivalent, then the notebook passes. The ratio printed of the means of the two images should be approximately 1.
Author: M. Cracraft, Senior Staff Scientist, INS/MIRI
Updated On: 04/02/2021 to add in testing the 'ratio' scaling option in resample.
